Skip to content

Zoomeye bulletproof multipage results #21770

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
e2002e wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Zoomeye bulletproof multipage results #21770

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
5f5554c
Update zoomeye_search.rb
e2002e Aug 10, 2026
68dc147
Update zoomeye_search.rb
e2002e Aug 10, 2026
1506680
Update zoomeye_search.rb
e2002e Aug 11, 2026
b426e5c
Update zoomeye_search.rb
e2002e Aug 11, 2026
cef7c6f
Update zoomeye_search.rb
e2002e Aug 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 23 additions & 7 deletions modules/auxiliary/gather/zoomeye_search.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,7 @@ def dork_search(resource, dork, page, facets, api_key)
'headers' => { 'API-KEY' => api_key },
'vars_get' => {
'query' => dork,
'pagesize' => 10,
'page' => page.to_s,
'facets' => facets
}
Expand Down Expand Up @@ -138,10 +139,10 @@ def run
end

# Determine page count based on total results
if results[first_page]['total'] % 20 == 0
tpages = results[first_page]['total'] / 20
if results[first_page]['total'] % 10 == 0
tpages = results[first_page]['total'] / 10
else
tpages = results[first_page]['total'] / 20 + 1
tpages = results[first_page]['total'] / 10 + 1
end
maxpage = tpages if datastore['MAXPAGE'] > tpages

Expand All @@ -162,14 +163,29 @@ def run
else
print_status("Total: #{results[first_page]['total']} on #{tpages} " \
"pages. Showing: #{maxpage} page(s)")
# If search results greater than 20, loop & get all results
if results[first_page]['total'] > 20
# If search results greater than 10, loop & get all results
if results[first_page]['total'] > 10
print_status('Collecting data, please wait...')
page = 1
skipped = 0
retrying = 0
while page < maxpage
page_result = dork_search(resource, dork, page + 1, facets, api_key)
page_result = dork_search(resource, dork, page + skipped + 1, facets, api_key)
if page_result['matches'].nil?
next
retrying += 1
if retrying < 3
next
else
retrying = 0
print_error("Skipping page #{page + skipped}")
if page + skipped >= maxpage #stop the strafe once we reach the theorical maxpage, but let it try a last one first.
break
end
skipped += 1
next
end
else
retrying = 0
end
Comment on lines 172 to 189

results[page] = page_result
Expand Down
Loading