----- Bot: Logs manager init ----- ----- Bot: Task DownloadMediaWiki started ----- ----- Bot: command: wikiteam3dumpgenerator --xml --images --xmlrevisions https://www.psdevwiki.com/psclassic/ ----- No suitable dump found at Internet Archive Checking API... https://www.psdevwiki.com/psclassic/api.php API is OK: https://www.psdevwiki.com/psclassic/api.php Checking index.php... https://www.psdevwiki.com/psclassic/index.php check_index(): Trying Special:Random... POST https://www.psdevwiki.com/psclassic/index.php {'title': 'Special:Random'} 302 GET http://www.psdevwiki.com/psclassic/Main_Page {'title': 'Special:Random'} 301 GET https://www.psdevwiki.com/psclassic/Main_Page {'title': 'Special:Random'} 200 index.php available probability: 90% (0.9) index.php is OK No --path argument provided. Defaulting to: [working_directory]/[domain_prefix]-[date]-wikidump Which expands to: ./www.psdevwiki.com_psclassic-20231025-wikidump --delay is the default value of 1.5 There will be a 1.5 second delay between HTTP calls in order to keep the server from timing you out. If you know that this is unnecessary, you can manually specify '--delay 0.0'. ######################################################################### # Welcome to DumpGenerator 4.1.4 by WikiTeam3 (GPL v3) # # More info at: https://github.com/saveweb/wikiteam3 # # Copyright (C) 2011-2023 WikiTeam developers # ######################################################################### Analysing https://www.psdevwiki.com/psclassic/api.php Trying generating a new dump into a new directory... https://www.psdevwiki.com/psclassic/api.php Getting the XML header from the API Retrieving the XML for every page from the beginning Trying to export all revisions from namespace -1 Trying to get wikitext from the allrevisions API and to build the XML [arvcontinue]: Delay 1.5s. Main Page, 8 edits (--xmlrevisions) Template:Box-footer-empty, 1 edits (--xmlrevisions) Template:Main page box, 1 edits (--xmlrevisions) Template:Box-header, 1 edits (--xmlrevisions) Template:Box-footer, 1 edits (--xmlrevisions) Template:Contribute, 1 edits (--xmlrevisions) PlayStation Classic, 3 edits (--xmlrevisions) Other Exploits, 1 edits (--xmlrevisions) PlayStation Classic Game Compatibility List, 3 edits (--xmlrevisions) Yifan Lu's UART, 2 edits (--xmlrevisions) MediaWiki:Sidebar, 1 edits (--xmlrevisions) PS1 Classics Emulator Compatibility Page, 2 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility Page, 2 edits (--xmlrevisions) Template:Playable, 1 edits (--xmlrevisions) Template:Minorissues, 1 edits (--xmlrevisions) Template:Majorissues, 1 edits (--xmlrevisions) Template:Unplayable, 1 edits (--xmlrevisions) Template:Notavailable, 1 edits (--xmlrevisions) Template:Preinstalled, 1 edits (--xmlrevisions) Template:Dot, 2 edits (--xmlrevisions) Template:·, 3 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility List, 1 edits (--xmlrevisions) PS1 Classics Emulator Compatibility List, 2 edits (--xmlrevisions) Template:Insert, 1 edits (--xmlrevisions) Template:Insertonly, 1 edits (--xmlrevisions) Template:Clear, 1 edits (--xmlrevisions) Template:Flag, 1 edits (--xmlrevisions) Template:Flagonly, 1 edits (--xmlrevisions) File:Europe.png, 1 edits (--xmlrevisions) File:Japan.png, 1 edits (--xmlrevisions) File:United States.png, 1 edits (--xmlrevisions) File:807066.png, 1 edits (--xmlrevisions) [arvcontinue]: 20181208181158|59 Delay 1.5s. File:807063.png, 1 edits (--xmlrevisions) PlayStation Classic, 10 edits (--xmlrevisions) Template:Flag, 2 edits (--xmlrevisions) Template:Flagonly, 2 edits (--xmlrevisions) Template:Playable, 1 edits (--xmlrevisions) Template:Minorissues, 1 edits (--xmlrevisions) Template:Majorissues, 1 edits (--xmlrevisions) Template:Unplayable, 1 edits (--xmlrevisions) Template:Notavailable, 1 edits (--xmlrevisions) Template:Preinstalled, 1 edits (--xmlrevisions) Template:·, 1 edits (--xmlrevisions) Template:Dot, 1 edits (--xmlrevisions) Template:Insert, 1 edits (--xmlrevisions) Template:Insertonly, 1 edits (--xmlrevisions) Template:Clear, 1 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility List, 4 edits (--xmlrevisions) PS1 Classics Emulator Compatibility List, 12 edits (--xmlrevisions) Main Page, 3 edits (--xmlrevisions) CPU, 5 edits (--xmlrevisions) [arvcontinue]: 20181210172626|109 Delay 1.5s. GPU, 1 edits (--xmlrevisions) Motherboard, 1 edits (--xmlrevisions) Main Page, 2 edits (--xmlrevisions) PS1 Classics Emulator Compatibility List, 37 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility List, 8 edits (--xmlrevisions) PlayStation Classic, 1 edits (--xmlrevisions) [arvcontinue]: 20190127230024|159 Delay 1.5s. PS1 Classics Emulator Compatibility List, 43 edits (--xmlrevisions) MediaWiki:Sidebar, 1 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility List, 6 edits (--xmlrevisions) [arvcontinue]: 20191027135848|213 Delay 1.5s. PS1 Classics Emulator Compatibility List, 29 edits (--xmlrevisions) User talk:SteelRain84, 5 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility List, 10 edits (--xmlrevisions) CPU, 2 edits (--xmlrevisions) MediaWiki:Sidebar, 4 edits (--xmlrevisions) [arvcontinue]: 20220123183744|263 Delay 1.5s. Template:Playable, 1 edits (--xmlrevisions) Template:Minorissues, 1 edits (--xmlrevisions) Template:Majorissues, 1 edits (--xmlrevisions) Template:Unplayable, 1 edits (--xmlrevisions) Template:Notavailable, 1 edits (--xmlrevisions) Template:Preinstalled, 1 edits (--xmlrevisions) PS1 Classics Emulator Compatibility List, 16 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility List, 1 edits (--xmlrevisions) Template:Available, 1 edits (--xmlrevisions) Tools, 1 edits (--xmlrevisions) Filesystem, 1 edits (--xmlrevisions) Removed, 1 edits (--xmlrevisions) PlayStation Classic, 2 edits (--xmlrevisions) MediaWiki:Sidebar, 3 edits (--xmlrevisions) MediaWiki:Common.css, 1 edits (--xmlrevisions) Template:Caution, 2 edits (--xmlrevisions) Template:Mbox, 2 edits (--xmlrevisions) Template:Namespace detect, 2 edits (--xmlrevisions) Template:Ombox, 2 edits (--xmlrevisions) Template:Ombox/core, 2 edits (--xmlrevisions) Template:Documentation, 2 edits (--xmlrevisions) Template:Documentation/docname, 1 edits (--xmlrevisions) Template:Pp-template, 1 edits (--xmlrevisions) Template:Pp-meta, 1 edits (--xmlrevisions) Template:Ambox, 2 edits (--xmlrevisions) [arvcontinue]: 20230411042701|321 Delay 1.5s. Template:Documentation/docname, 1 edits (--xmlrevisions) Template:Pp-meta, 1 edits (--xmlrevisions) Template:Pp-template, 1 edits (--xmlrevisions) User:Derf, 1 edits (--xmlrevisions) Template:Imbox, 2 edits (--xmlrevisions) Template:Yesno, 2 edits (--xmlrevisions) MediaWiki:Sidebar, 6 edits (--xmlrevisions) User talk:Derf, 1 edits (--xmlrevisions) Template:Tmbox, 2 edits (--xmlrevisions) Template:Tmbox/core, 2 edits (--xmlrevisions) Template:Contribute, 2 edits (--xmlrevisions) Mediawiki Help, 3 edits (--xmlrevisions) MediaWiki:Common.css, 3 edits (--xmlrevisions) Main Page, 1 edits (--xmlrevisions) File:Console PSClassic.png, 2 edits (--xmlrevisions) Template:PS1 Classics Emulator Compatibility List, 2 edits (--xmlrevisions) XML dump saved at... www.psdevwiki.com_psclassic-20231025-history.xml )Retrieving image filenames Using API to retrieve image names... Using API:Allimages to get the list of images, 0 images found so far... Delay 1.5s. 6 Found 6 images Sorting image filenames (6 images)... Done Image metadata saved at... www.psdevwiki.com_psclassic-20231025-images.txt Retrieving images... Creating "www.psdevwiki.com_psclassic-20231025-wikidump/images" directory Delay 1.5s. | 5=>807063.png Delay 1.5s. | 4=>807066.png Delay 1.5s. | 3=>Console_PSClassic.png Delay 1.5s. | 2=>Europe.png Delay 1.5s. | 1=>Japan.png Delay 1.5s. | 0=>United_States.png Downloaded 6 files Undo monkey patch... Downloading index.php (Main Page) as index.html Delay 1.5s. Downloading Special:Version with extensions and other related info Delay 1.5s. Downloading site info as siteinfo.json Delay 1.5s. ---> Done <--- If this is a public wiki, please, consider publishing this dump to the Internet Archive: `wikiteam3uploader ./www.psdevwiki.com_psclassic-20231025-wikidump` Good luck! Bye! ----- Bot: Task DownloadMediaWiki finished ----- ----- Bot: Exit code: 0 ----- ----- Bot: Task UploadMediaWiki started ----- ----- Bot: command: wikiteam3uploader www.psdevwiki.com_psclassic-20231025-wikidump --zstd-level 22 --parallel ----- *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** Note: 8 physical core(s) detected /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-history.xml : 1.22% ( 5.43 MiB => 67.7 KiB, /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-history.xml.zst.tmp) *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-history.xml.zst: 5689898 bytes *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** Note: 8 physical core(s) detected /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-images.txt : 46.64% ( 922 B => 430 B, /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-images.txt.zst.tmp) *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-images.txt.zst: 922 bytes 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI) Scanning the drive: 1 folder, 6 files, 1271490 bytes (1242 KiB) Creating archive: /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/images.7z.tmp Items to compress: 7 Files read from disk: 6 Archive size: 1271808 bytes (1242 KiB) Everything is Ok 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI) Scanning the drive for archives: 1 file, 1271808 bytes (1242 KiB) Testing archive: /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-images.7z -- Path = /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-images.7z Type = 7z Physical Size = 1271808 Headers Size = 318 Method = Copy Solid = - Blocks = 6 Everything is Ok Folders: 1 Files: 6 Size: 1271490 Compressed: 1271808 Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True) === Loading config from /root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump === Config(delay=1.5, retries=5, path='/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump', logs=False, date='20231025', index='https://www.psdevwiki.com/psclassic/index.php', api='https://www.psdevwiki.com/psclassic/api.php', xml=True, curonly=False, xmlapiexport=False, xmlrevisions=True, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False, warc_images=False, warc_pages=False, warc_pages_history=False) === Preparing files to upload === === commpressing necessary files: === === Files already uploaded: === Already uploaded 0 files. (0 files in remote item in total) === Files to upload: === "www.psdevwiki.com_psclassic-20231025-dumpMeta/config.json" from "/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/config.json" "www.psdevwiki.com_psclassic-20231025-dumpMeta/SpecialVersion.html" from "/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/SpecialVersion.html" "www.psdevwiki.com_psclassic-20231025-dumpMeta/siteinfo.json" from "/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/siteinfo.json" "www.psdevwiki.com_psclassic-20231025-dumpMeta/index.html" from "/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/index.html" "www.psdevwiki.com_psclassic-20231025-history.xml.zst" from "/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-history.xml.zst" "www.psdevwiki.com_psclassic-20231025-dumpMeta/www.psdevwiki.com_psclassic-20231025-images.txt.zst" from "/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-images.txt.zst" "www.psdevwiki.com_psclassic-20231025-images.7z" from "/root/wikibot/jobs/a9166e33-f5ad-4205-b198-b562ab5d5e18/www.psdevwiki.com_psclassic-20231025-wikidump/www.psdevwiki.com_psclassic-20231025-images.7z" 7 files ready to upload... === Preparing metadata === === Item metadata: === { "collection": "opensource", "description": "PlayStation Classic Developer wiki dumped with wikiteam3 tools.", "language": "en", "last-updated-date": "2023-10-25", "licenseurl": "http://www.gnu.org/licenses/old-licenses/fdl-1.2.txt", "mediatype": "web", "originalurl": "https://www.psdevwiki.com/psclassic/api.php", "rights": "GNU Free Documentation License 1.2", "scanner": "wikiteam3 (v4.1.4)", "subject": "wiki; wikiteam; wikiteam3; MediaWiki; www.psdevwiki.com_psclassic; PlayStation Classic Developer wiki", "title": "Wiki - PlayStation Classic Developer wiki", "upload-state": "uploading" } logo_url: http://www.psdevwiki.com/psclassic/logo.png === Checking IA S3 load average (optional) === IA S3 load: 7.3506% === Uploading === uploading www.psdevwiki.com_psclassic-20231025-dumpMeta/config.json: 0%| | 0/1 [00:00