New Platform IMDb Movie Additional Pages Script - SeleniumBase

Started by afrocuban, 9 31 October, 2026, 09:22:01 PM

Previous topic - Next topic

afrocuban

Script Description: This script automates the downloading of various IMDb movie additional pages using SeleniumBase (UC Mode) and ChromeDriver.
                    It runs headless, implements robust AWS WAF challenge detection, and saves the resulting HTML files locally.
                    Sequential execution and persistent profile reuse are used to bypass bot-detection systems effectively.

Author: [afrocuban]
Version: 4.0.0
Date: 2026-10-31
Dependencies: pip install seleniumbase - you have to install this package via cmd
CHANGE LOG:
                Version: 4.0.0.1 Date: 2026-10-31
                    - Refactored from Selenium to SeleniumBase UC Mode for superior WAF bypass
                    - Added robust challenge detection (URL path + DOM element checks)
                    - Implemented sequential execution and persistent profile reuse
                    - Optimized headless=True execution with eager page load strategy

You don't have to delete or backup anything. Just put the scripts in your /Scripts folder and everything works out of the box. What is important, now it will even automatically download ChromeDriver when needed.

Just be notified of this part of the IMDB script:

Quote(* //Uncomment and comment next secton when you want to use Selenium based script
            FileExecute('pythonw.exe', '"' + ScriptPath + 'Selenium_Chrome_Movie_Additional_pages_v4.py" "' + URL + '" "' + ScriptPath + BASE_DOWNLOAD_FILE_NO_BOM + '" "' + EXCLUDED_FILES + '"');
            //*)

            FileExecute('pythonw.exe', '"' + ScriptPath + 'Selenium_Chrome_Movie_Additional_pages_SBase_v4.py" "' + URL + '" "' + ScriptPath + BASE_DOWNLOAD_FILE_NO_BOM + '" "' + EXCLUDED_FILES + '"');

The script was created by my local unsloth's Qwen3.6-35B-A3B-MTP-UD-Q4_K_XL.gguf LLM running on JakeATX's fork of llama.cpp, with my oversight and testing.

Ivek23

Very interesting and thanks for this correction.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD