----- Bot: Logs manager init ----- ----- Bot: Task DownloadMediaWiki started ----- ----- Bot: command: wikiteam3dumpgenerator --images --xmlrevisions https://wiki.aaroads.com/wiki/ ----- No suitable dump found at Internet Archive Checking API... https://wiki.aaroads.com/w/api.php API is OK: https://wiki.aaroads.com/w/api.php Checking index.php... https://wiki.aaroads.com/w/index.php check_index(): Trying Special:Random... POST https://wiki.aaroads.com/w/index.php {'title': 'Special:Random'} 302 GET https://wiki.aaroads.com/wiki/Georgia_State_Route_172 {'title': 'Special:Random'} 200 index.php available probability: 90% (0.9) index.php is OK No --path argument provided. Defaulting to: [working_directory]/[domain_prefix]-[date]-wikidump Which expands to: ./wiki.aaroads.com_w-20230926-wikidump --delay is the default value of 1.5 There will be a 1.5 second delay between HTTP calls in order to keep the server from timing you out. If you know that this is unnecessary, you can manually specify '--delay 0.0'. ######################################################################### # Welcome to DumpGenerator 4.1.4 by WikiTeam3 (GPL v3) # # More info at: https://github.com/saveweb/wikiteam3 # # Copyright (C) 2011-2023 WikiTeam developers # ######################################################################### Analysing https://wiki.aaroads.com/w/api.php Trying generating a new dump into a new directory... )Retrieving image filenames Using API to retrieve image names... Using API:Allimages to get the list of images, 0 images found so far... Delay 1.5s. 50 I-Pass_(logo).png Using API:Allimages to get the list of images, 50 images found so far... Delay 1.5s. 100 Pennyrile_Parkway_fair_use.svg Using API:Allimages to get the list of images, 100 images found so far... Delay 1.5s. 136 Found 136 images Sorting image filenames (136 images)... Done Image metadata saved at... wiki.aaroads.com_w-20230926-images.txt Retrieving images... Creating "wiki.aaroads.com_w-20230926-wikidump/images" directory Delay 1.5s. | 135=>183A_Toll_Road.svg Delay 1.5s. | 134=>183_Toll_Road.svg Delay 1.5s. | 133=>290_Toll_Road.svg Delay 1.5s. | 132=>427_and_409_intersection.png Delay 1.5s. | 131=>427_and_QEW_reconstruction,_1967.png Delay 1.5s. | 130=>AARW_welcome_AZ.svg Delay 1.5s. | 129=>AARW_welcome_MI.svg Delay 1.5s. | 128=>AARW_welcome_MN.svg Delay 1.5s. | 127=>AARW_welcome_TX.svg Delay 1.5s. | 126=>AARW_welcome_WI.svg Delay 1.5s. | 125=>AARoads_logo.svg Delay 1.5s. | 124=>Alberta_Highway_11_(David_Thompson).svg Delay 1.5s. | 123=>Alberta_Highway_14_(Poundmaker).svg Delay 1.5s. | 122=>Alberta_Highway_1A_(Bow_Valley).svg Delay 1.5s. | 121=>Alberta_Highway_22_(Cowboy_Trail).svg Delay 1.5s. | 120=>Alberta_Highway_33_(Grizzly).png Delay 1.5s. | 119=>Alberta_Highway_35_(Mackenzie).png Delay 1.5s. | 118=>Alberta_Highway_36_(Veteran_Memorial).svg Delay 1.5s. | 117=>Alberta_Highway_3_(Crowsnest).svg Delay 1.5s. | 116=>Alberta_Highway_40_(Bighorn).svg Delay 1.5s. | 115=>Alberta_Highway_41_(Buffalo_Trail).svg Delay 1.5s. | 114=>Alberta_Highway_60_(Devonian).svg Delay 1.5s. | 113=>Alberta_Highway_88_(Bicentennial).png Delay 1.5s. | 112=>Alberta_Yellowhead_Highway.png Delay 1.5s. | 111=>Arkansas_Department_of_Transportation_Logo.svg Delay 1.5s. | 110=>Audubon_Parkway_fair_use.svg Delay 1.5s. | 109=>Bluegrass_Parkway_fair_use.svg Delay 1.5s. | 108=>British_Columbia_Highway_113.svg Delay 1.5s. | 107=>British_Columbia_Highway_3.svg Delay 1.5s. | 106=>COSMIX_logo.jpg Delay 1.5s. | 105=>Carnage_Alley.png Delay 1.5s. | 104=>Chicago_Department_of_Transportation_Logo.png Delay 1.5s. | 103=>Cobequid_Pass_logo.png Delay 1.5s. | 102=>Colorado_Department_of_Transportation_logo.png Delay 1.5s. | 101=>Cover_HCM2000_low_res.jpg Delay 1.5s. | 100=>Craig_County.svg Delay 1.5s. | 99=>Crowleys_Ridge_Scenic_Byway_AR_sign.jpg Delay 1.5s. | 98=>Cumberland_Parkway_fair_use.svg Delay 1.5s. | 97=>DelDOT.svg Delay 1.5s. | 96=>Dinosaur_Trail_(Alberta_Highway).svg Delay 1.5s. | 95=>Evangeli.png Delay 1.5s. | 94=>Fastlane.png Delay 1.5s. | 93=>Fort_Bend_Parkway_Toll_Road_logo.png Delay 1.5s. | 92=>Fort_Bend_Westpark_Tollway_logo.png Delay 1.5s. | 91=>Gardiner_UC.png Delay 1.5s. | 90=>Glooscap.png Delay 1.5s. | 89=>H1_freeway_1965.jpg Delay 1.5s. | 88=>Hal_Rogers_Parkway_fair_use.svg Delay 1.5s. | 87=>Highway_11A_aerial,_1947.png Delay 1.5s. | 86=>Hwy_35_Wilmot_Creek_grading,_1955.png Delay 1.5s. | 85=>I-Pass_(logo).png Delay 1.5s. | 84=>IL_DOT.svg Delay 1.5s. | 83=>ITRLogo_Color.png Delay 1.5s. | 82=>ITS.ENGINEER.jpg Delay 1.5s. | 81=>Illiana_Logo.jpg Delay 1.5s. | 80=>Illinois_River_Road.svg Delay 1.5s. | 79=>Illinois_Tollway_logo.png Delay 1.5s. | 78=>Intercounty_Connector_logo.png Delay 1.5s. | 77=>International_Selkirk_Loop.png Delay 1.5s. | 76=>Izoom_small.jpg Delay 1.5s. | 75=>KSDoT_logo.png Delay 1.5s. | 74=>KY_Transportation_Cabinet.jpg Delay 1.5s. | 73=>Lakeshore_expressway_1947.jpg Delay 1.5s. | 72=>Legacy_parkway.png Delay 1.5s. | 71=>Lighthou.png Delay 1.5s. | 70=>Louis_Riel_Trail.svg Delay 1.5s. | 69=>LoyalistParkway.png Delay 1.5s. | 68=>MS_DOT.svg Delay 1.5s. | 67=>MassHighway.svg Delay 1.5s. | 66=>Mass_Pike_shield.svg Delay 1.5s. | 65=>Masspike_logo_1955.jpg Delay 1.5s. | 64=>Mdt_logo_2020.jpg Delay 1.5s. | 63=>Mdx_logo_top.png Delay 1.5s. | 62=>MichiganDOT.svg Delay 1.5s. | 61=>Ministry_of_Transportation_Logo.png Delay 1.5s. | 60=>MoDOT_logo.svg Delay 1.5s. | 59=>Mount_Washington_Auto_Road_logo.png Delay 1.5s. | 58=>Mountain_Parkway_fair_use.svg Delay 1.5s. | 57=>NDDOT.svg Delay 1.5s. | 56=>NHDOTlogo.PNG Delay 1.5s. | 55=>NJTA_logo.png Delay 1.5s. | 54=>NJTP_(I_95)_IC_8_options.jpg Delay 1.5s. | 53=>NYSDOT_LOGO.png Delay 1.5s. | 52=>Nasco_corridor_logo.svg Delay 1.5s. | 51=>Natcher_Parkway_fair_use.svg Delay 1.5s. | 50=>Ncturnpikeauthority.png Delay 1.5s. | 49=>New_Brunswick_Canada_Logo.svg Delay 1.5s. | 48=>North_East_Texas_Regional_Mobility_Authority_logo. Delay 1.5s. | 47=>North_Tarrant_Express_logo.png Delay 1.5s. | 46=>Northern_Woods-Water-hwy-Blank.png Delay 1.5s. | 45=>Northern_Woods_and_Water_Route_(Alberta).svg Delay 1.5s. | 44=>OHSR8B64.png Delay 1.5s. | 43=>OKDOT.png Delay 1.5s. | 42=>OK_Turnpike_Authority_logo.png Delay 1.5s. | 41=>Octavia-Blvd-San-Francisco-rr.png Delay 1.5s. | 40=>Oregon_Department_of_Transportation_(logo).svg Delay 1.5s. | 39=>Oregon_Outback_Scenic_Byway_logo.jpg Delay 1.5s. | 38=>Panneau_I-130-1.svg Delay 1.5s. | 37=>Parkland_Highway.svg Delay 1.5s. | 36=>Peach_Pass_logo.png Delay 1.5s. | 35=>Pennyrile_Parkway_fair_use.svg Delay 1.5s. | 34=>PortMiami_Tunnel_logo.png Delay 1.5s. | 33=>Pub_ntta_logo.png Delay 1.5s. | 32=>Purchase_Parkway_fair_use.svg Delay 1.5s. | 31=>Queen_Elizabeth_II_Highway_(Alberta).svg Delay 1.5s. | 30=>Red_Coat_Trail_highway_shield.png Delay 1.5s. | 29=>Red_Coat_Trail_highway_shield.svg Delay 1.5s. | 28=>Richard_Aderson_homicide_suspect_sketch.jpg Delay 1.5s. | 27=>SCDOT.svg Delay 1.5s. | 26=>Seaway_Trail.svg Delay 1.5s. | 25=>Spadina-401_Interchange_Plan.png Delay 1.5s. | 24=>Spadina_Cancellation_Headline.jpg Delay 1.5s. | 23=>St._Clair_Parkway_Commission_logo.jpg Delay 1.5s. | 22=>Stoney_Creek_Cut_Drawing.png Delay 1.5s. | 21=>SunPassLogo.png Delay 1.5s. | 20=>T-REX_logo.jpg Delay 1.5s. | 19=>TDOT_Logo_Full_Color.png Delay 1.5s. | 18=>TDOT_work_on_Hernando_de_Soto_bridge_fracture.jpg Delay 1.5s. | 17=>TalbotTrailNew.png Delay 1.5s. | 16=>Tennessee_State_Route_475_alignment_-_2007.jpg Delay 1.5s. | 15=>Testsvgupload.svg Delay 1.5s. | 14=>Toronto_International_Airport_and_Airport_Expressw Delay 1.5s. | 13=>TxTag-logo.png Delay 1.5s. | 12=>US_20_Scenic_Byway_New_York.svg Delay 1.5s. | 11=>VTTRANS.svg Delay 1.5s. | 10=>Virginia_Department_of_Transportation_(logo).svg Delay 1.5s. | 9=>WVDOT_Logo.png Delay 1.5s. | 8=>WYDOT.svg Delay 1.5s. | 7=>West_Virginia_Turnpike_logo.png Delay 1.5s. | 6=>Western_Kentucky_Parkway_fair_use.svg Delay 1.5s. | 5=>Wilsonbridge1.JPG Delay 1.5s. | 4=>Wisconsin_Scenic_Byway_marker.svg Delay 1.5s. | 3=>Woodbine_facing_south.png Delay 1.5s. | 2=>Woodward_tribute.jpg Delay 1.5s. | 1=>Woodwardsign.jpg Delay 1.5s. | 0=>Yellowhead_Highway_(Saskatchewan).svg Downloaded 136 files Undo monkey patch... Downloading index.php (Main Page) as index.html Delay 1.5s. Downloading Special:Version with extensions and other related info Delay 1.5s. Downloading site info as siteinfo.json Delay 1.5s. ---> Done <--- If this is a public wiki, please, consider publishing this dump to the Internet Archive: `wikiteam3uploader ./wiki.aaroads.com_w-20230926-wikidump` Good luck! Bye! ----- Bot: Task DownloadMediaWiki finished ----- ----- Bot: Exit code: 0 ----- ----- Bot: Task UploadMediaWiki started ----- ----- Bot: command: wikiteam3uploader wiki.aaroads.com_w-20230926-wikidump --zstd-level 22 --parallel ----- *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** Note: 8 physical core(s) detected /root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/wiki.aaroads.com_w-20230926-images.txt : 28.26% ( 23.8 KiB => 6.74 KiB, /root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/wiki.aaroads.com_w-20230926-images.txt.zst.tmp) *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** /root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/wiki.aaroads.com_w-20230926-images.txt.zst: 24422 bytes 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI) Scanning the drive: 1 folder, 136 files, 17306387 bytes (17 MiB) Creating archive: /root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/images.7z.tmp Items to compress: 137 Files read from disk: 136 Archive size: 17309385 bytes (17 MiB) Everything is Ok 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI) Scanning the drive for archives: 1 file, 17309385 bytes (17 MiB) Testing archive: /root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/wiki.aaroads.com_w-20230926-images.7z -- Path = /root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/wiki.aaroads.com_w-20230926-images.7z Type = 7z Physical Size = 17309385 Headers Size = 2998 Method = Copy Solid = - Blocks = 136 Everything is Ok Folders: 1 Files: 136 Size: 17306387 Compressed: 17309385 Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True) === Loading config from /root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump === Config(delay=1.5, retries=5, path='/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump', logs=False, date='20230926', index='https://wiki.aaroads.com/w/index.php', api='https://wiki.aaroads.com/w/api.php', xml=False, curonly=False, xmlapiexport=False, xmlrevisions=True, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False, warc_images=False, warc_pages=False, warc_pages_history=False) === Preparing files to upload === === commpressing necessary files: === === Files already uploaded: === Already uploaded 0 files. (0 files in remote item in total) === Files to upload: === "wiki.aaroads.com_w-20230926-dumpMeta/config.json" from "/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/config.json" "wiki.aaroads.com_w-20230926-dumpMeta/SpecialVersion.html" from "/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/SpecialVersion.html" "wiki.aaroads.com_w-20230926-dumpMeta/siteinfo.json" from "/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/siteinfo.json" "wiki.aaroads.com_w-20230926-dumpMeta/index.html" from "/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/index.html" "wiki.aaroads.com_w-20230926-dumpMeta/wiki.aaroads.com_w-20230926-images.txt.zst" from "/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/wiki.aaroads.com_w-20230926-images.txt.zst" "wiki.aaroads.com_w-20230926-images.7z" from "/root/wikibot/jobs/19842282-84a7-49b4-b401-57251828a0fb/wiki.aaroads.com_w-20230926-wikidump/wiki.aaroads.com_w-20230926-images.7z" 6 files ready to upload... === Preparing metadata === === Item metadata: === { "collection": "opensource", "description": "AARoads Wiki dumped with wikiteam3 tools.", "language": "en", "last-updated-date": "2023-09-26", "licenseurl": null, "mediatype": "web", "originalurl": "https://wiki.aaroads.com/w/api.php", "rights": null, "scanner": "wikiteam3 (v4.1.4)", "subject": "wiki; wikiteam; wikiteam3; MediaWiki; wiki.aaroads.com_w; AARoads Wiki; unknowncopyright", "title": "Wiki - AARoads Wiki", "upload-state": "uploading" } logo_url: https://www.aaroads.com/wp-content/uploads/images/aaroads.png === Checking IA S3 load average (optional) === IA S3 load: 28.7441% === Uploading === uploading wiki.aaroads.com_w-20230926-dumpMeta/config.json: 0%| | 0/1 [00:00