I have been making an attempt to generate a personalized word list using Cewl on Kali Linux. I followed the most fundamental usage of Cewl with verbose mode enabled:
cewl
www.whateverwebsite.com -v
However, upon executing this command, I receive an unusual message that states:
CeWL 6.1 (Max Length) Robin Wood (
robin@digi.ninja) (
DigiNinja - DigiNinja)
Starting at
whateverwebsite.com - This website is for sale! - sites like Resources and Information.
Offsite link, not following:
https://www.whateverwebsite.com
Words found
Despite this message appearing, I don't observe any output or the website being crawled effectively. This issue doesn't seem to be limited to just one site as I have encountered the same problem while trying several others.
I have updated Kali and upgraded all upgradeable packages but haven't noticed any improvements in this regard.
Has anyone come across a solution to make Cewl function appropriately for crawling websites and generating a word list?