How to delete all rows which contains a specific value or character in a mysql database table

On my last posts I had crawled a lot of domain name on a mysql table. And now there is a new problem with specific characters like “:” and port numbers. For example: Now I want to delete all this domain names which contains the port numbers in field “url”. MySQL command for find and … Read more

how to remove duplicate rows in mysql with using temporary table

after i get 100 Million of url’s, i saw a few of duplicates on my mysql table. I used the command line because the MySQL Workbench was not usable with minimum system resources. For login on Terminal on Mac OS X with MySQL Community Server version: 8.0.29 – GPL after this command, u need to … Read more

crawlers list with github repos – python, go, java, php & co

“There are only two hard things in Computer Science: cache invalidation and naming things” Phil Karlton on my last post from 30 March 2022, I started with same crawlers to finding unique hostnames and then collecting them on a mysql database. Example Crawler: dcrawl – searches hostnames from given start url. A free open-source project … Read more