No addrrss found for host

[1Jesper1]

httpx version:

1.7.1

Current Behavior:

param -l without -threads 1 gives "no address found for host" after first domain in file.

Expected Behavior:

httpx with -l param with a list of domains should work without throwing "no address found for host"

Steps To Reproduce:

1.Create a domains.txt file with 2 domains.
2. Run httpx -l domains.txt -title -server -tech-detect -o output.txt -v
3. You see the first domain is successful, but the second gives error.
4. By adding -threads 1, the second domain will not throw the error.

[Mzack9999]

This is not reproducible

% httpx -l list.txt -title -server -tech-detect -o output.txt -v

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

                projectdiscovery.io

[INF] Current httpx version v1.7.1 (latest)
[WRN] UI Dashboard is disabled, Use -dashboard option to enable
https://scanme.sh []
https://projectdiscovery.io [ProjectDiscovery - Vulnerability management reimagined] [Vercel] [HSTS,Next.js,Node.js,React,Vercel,Webpack]

Please if the issue persist provide all the necessary info including full CLI and tool output

[1Jesper1]

First run was with:
https://google.com
https://google.nl

Second run was with:
google.com
google.nl

@Mzack9999 Could you test the above?

[Mzack9999]

It works well for me:

% httpx -l list1.txt -title -server -tech-detect -o output.txt -v

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

                projectdiscovery.io

[INF] Current httpx version v1.7.1 (latest)
[WRN] UI Dashboard is disabled, Use -dashboard option to enable
https://google.nl [301 Moved] [gws] [Google Web Server,HTTP/3]
https://google.com [301 Moved] [gws] [Google Web Server,HTTP/3]

Are you experiencing this consistently or randomly?

[1Jesper1]

@Mzack9999 Thanks for testing, I found the problem at my side: Problem was caused by my VPN.

[Mzack9999]

Glad you managed to find the root cause!

[ocervell]

@Mzack9999 I'm also behind a VPN, but:

httpx-toolkit -u https://github.com -v

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

                projectdiscovery.io

[INF] Current httpx version v1.7.0 (outdated)
[WRN] UI Dashboard is disabled, Use -dashboard option to enable
[DBG] Failed 'https://github.com': Get "https://github.com": cause="no address found for host"

However, curl https://github.com works.

Any idea why httpx wouldn't work in that case ? Does it do something different than curl ?

[ocervell]

Okay, it was due to httpx not being able to read my system proxy HTTP_PROXY / HTTPS_PROXY env variables, while curl can do that.
I had to explicitely pass -proxy=<proxy_url> to make it work.