----- Bot: Starting Task: WikiTeam3 -----
----- Bot: Command: wikiteam3dumpgenerator --delay 0.0 --xml --images --xmlrevisions https://americanrails.wikiforge.net/ -----
No suitable dump found at Internet Archive
Checking API... https://americanrails.wikiforge.net/1.40/api.php
API is OK: https://americanrails.wikiforge.net/1.40/api.php
Checking index.php... https://americanrails.wikiforge.net/1.40/index.php
index.php is OK
No --path argument provided. Defaulting to:
[working_directory]/[domain_prefix]-[date]-wikidump
Which expands to:
./americanrails.wikiforge.net_1_40-20230825-wikidump
#########################################################################
# Welcome to DumpGenerator 4.0.18 by WikiTeam3 (GPL v3) #
# More info at: https://github.com/saveweb/wikiteam3 #
# Copyright (C) 2011-2023 WikiTeam developers #
#########################################################################
Analysing https://americanrails.wikiforge.net/1.40/api.php
Trying generating a new dump into a new directory...
https://americanrails.wikiforge.net/1.40/api.php
Getting the XML header from the API
Retrieving the XML for every page from the beginning
Trying to export all revisions from namespace -1
Trying to get wikitext from the allrevisions API and to build the XML
MediaWiki:Gadget-HotCat, 8 edits (--xmlrevisions)
File:PascackValleyLine.svg, 13 edits (--xmlrevisions)
MediaWiki:Right-changetags, 1 edits (--xmlrevisions)
MediaWiki:Right-applychangetags, 1 edits (--xmlrevisions)
MediaWiki:Right-deletechangetags, 1 edits (--xmlrevisions)
MediaWiki:Right-managechangetags, 1 edits (--xmlrevisions)
MediaWiki:Action-changetags, 1 edits (--xmlrevisions)
MediaWiki:Right-protectsite, 1 edits (--xmlrevisions)
MediaWiki:Action-protectsite, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-flood, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-oversight, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-steward, 1 edits (--xmlrevisions)
Main Page, 3 edits (--xmlrevisions)
File:Wiki.png, 2 edits (--xmlrevisions)
User:Amanda Catherine, 1 edits (--xmlrevisions)
User talk:Amanda Catherine, 1 edits (--xmlrevisions)
User:Matthew Wong, 1 edits (--xmlrevisions)
User talk:Matthew Wong, 1 edits (--xmlrevisions)
New Jersey Transit, 2 edits (--xmlrevisions)
New Jersey Transit Rail Operations, 1 edits (--xmlrevisions)
NJT, 1 edits (--xmlrevisions)
File:MorristownLine.svg, 1 edits (--xmlrevisions)
File:GladstoneBranch.svg, 1 edits (--xmlrevisions)
File:MontclairBoontonLine.svg, 1 edits (--xmlrevisions)
File:RaritanValleyLine.svg, 1 edits (--xmlrevisions)
File:NortheastCorridorLine.svg, 1 edits (--xmlrevisions)
File:AtlanticCityLine.svg, 1 edits (--xmlrevisions)
File:BergenCountyLine.svg, 3 edits (--xmlrevisions)
File:PascackValleyLine.svg, 3 edits (--xmlrevisions)
File:MainLine.svg, 3 edits (--xmlrevisions)
File:NorthJerseyCoastLine.svg, 3 edits (--xmlrevisions)
File:MontclairBoontonLine.svg, 2 edits (--xmlrevisions)
File:MorristownLine.svg, 2 edits (--xmlrevisions)
File:GladstoneBranch.svg, 2 edits (--xmlrevisions)
File:NortheastCorridorLine.svg, 2 edits (--xmlrevisions)
File:AtlanticCityLine.svg, 2 edits (--xmlrevisions)
File:RaritanValleyLine.svg, 2 edits (--xmlrevisions)
New Jersey Transit, 4 edits (--xmlrevisions)
MediaWiki:Group-accountcreator, 1 edits (--xmlrevisions)
MediaWiki:Group-accountcreator-member, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-accountcreator, 1 edits (--xmlrevisions)
MediaWiki:Group-importer, 1 edits (--xmlrevisions)
MediaWiki:Group-importer-member, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-importer, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-ipblock-exempt, 1 edits (--xmlrevisions)
MediaWiki:Group-pagemover, 1 edits (--xmlrevisions)
MediaWiki:Group-pagemover-member, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-pagemover, 1 edits (--xmlrevisions)
MediaWiki:Group-researcher, 1 edits (--xmlrevisions)
MediaWiki:Group-researcher-member, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-researcher, 1 edits (--xmlrevisions)
MediaWiki:Group-uploader, 1 edits (--xmlrevisions)
MediaWiki:Group-uploader-member, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-uploader, 1 edits (--xmlrevisions)
Project:Mission Statement, 2 edits (--xmlrevisions)
Project:Mission, 1 edits (--xmlrevisions)
Project:About, 1 edits (--xmlrevisions)
Main Page, 2 edits (--xmlrevisions)
Main Page, 4 edits (--xmlrevisions)
New Jersey Transit, 3 edits (--xmlrevisions)
MediaWiki:Grouppage-patroller, 1 edits (--xmlrevisions)
Template:Infobox NJ Transit, 5 edits (--xmlrevisions)
Atlantic City Line, 3 edits (--xmlrevisions)
Template:Infobox station, 5 edits (--xmlrevisions)
Project:Privacy policy, 3 edits (--xmlrevisions)
MediaWiki:Right-templateeditor, 1 edits (--xmlrevisions)
MediaWiki:Group-templateeditor, 1 edits (--xmlrevisions)
MediaWiki:Group-templateeditor-member, 1 edits (--xmlrevisions)
MediaWiki:Grouppage-templateeditor, 1 edits (--xmlrevisions)
Atlantic City Rail Terminal, 3 edits (--xmlrevisions)
File:NJ Transit Comet V Cabcar at Atlantic City Rail Terminal.jpeg, 1 edits (--xmlrevisions)
File:Platform and Train at Atlantic City Rail Terminal.jpeg, 1 edits (--xmlrevisions)
File:Concourse at Atlantic City Rail Terminal 1.jpeg, 1 edits (--xmlrevisions)
File:Concourse at Atlantic City Rail Terminal 2.jpeg, 1 edits (--xmlrevisions)
Atlantic City station, 1 edits (--xmlrevisions)
MediaWiki:Gadget-HotCat.js, 1 edits (--xmlrevisions)
MediaWiki:Gadget-HotCat, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-blank, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-new-redirect, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-changed-redirect-target, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-removed-redirect, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-manual-revert, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-reverted, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-replace, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-rollback, 1 edits (--xmlrevisions)
MediaWiki:Tag-mw-undo, 1 edits (--xmlrevisions)
MediaWiki:Tag-mobile edit, 1 edits (--xmlrevisions)
MediaWiki:Tag-mobile web edit, 1 edits (--xmlrevisions)
MediaWiki:Tag-advanced mobile edit, 1 edits (--xmlrevisions)
MediaWiki:Tag-abusefilter-condition-limit, 1 edits (--xmlrevisions)
MediaWiki:Tag-tor, 1 edits (--xmlrevisions)
MediaWiki:Gadgets-definition, 1 edits (--xmlrevisions)
Category:New Jersey Transit, 2 edits (--xmlrevisions)
Atlantic City Line, 2 edits (--xmlrevisions)
Atlantic City Rail Terminal, 5 edits (--xmlrevisions)
Category:Atlantic City Line, 2 edits (--xmlrevisions)
Main Page, 2 edits (--xmlrevisions)
File:Platform at Absecon station looking north.jpeg, 2 edits (--xmlrevisions)
File:Platform at Absecon station looking south.jpeg, 1 edits (--xmlrevisions)
File:Northbound train arriving at Absecon station.jpeg, 1 edits (--xmlrevisions)
File:Northbound train at Absecon station.jpeg, 1 edits (--xmlrevisions)
Absecon station, 2 edits (--xmlrevisions)
Template:Infobox station, 1 edits (--xmlrevisions)
User:Matthew Wong, 1 edits (--xmlrevisions)
User talk:Matthew Wong, 1 edits (--xmlrevisions)
User:Amanda Catherine, 1 edits (--xmlrevisions)
XML dump saved at... americanrails.wikiforge.net_1_40-20230825-history.xml
)Retrieving image filenames
Using API to retrieve image names...
Using API:Allimages to get the list of images, 0 images found so far...
19
Found 19 images
Sorting image filenames
19 image names loaded
['AtlanticCityLine.svg', 'https://static.wikiforge.net/americanrailswiki/5/58/AtlanticCityLine.svg', 'Matthew Wong', 2711, 'afd4a8960083d30d8b218a9d8c33ee4e8e24a669', '2023-07-21T18:18:32Z']
['BergenCountyLine.svg', 'https://static.wikiforge.net/americanrailswiki/7/7f/BergenCountyLine.svg', 'Matthew Wong', 5623, '61e0593a249e104044f99995a9d866f08af6dcd4', '2023-07-21T18:05:53Z']
['Concourse at Atlantic City Rail Terminal 1.jpeg', 'https://static.wikiforge.net/americanrailswiki/9/90/Concourse_at_Atlantic_City_Rail_Terminal_1.jpeg', 'Matthew Wong', 823746, '4ca8f0a7e9715d5d33f9a6c5f84cee07f9ea832f', '2023-08-10T22:35:27Z']
['Concourse at Atlantic City Rail Terminal 2.jpeg', 'https://static.wikiforge.net/americanrailswiki/3/35/Concourse_at_Atlantic_City_Rail_Terminal_2.jpeg', 'Matthew Wong', 692819, '443cda4f30bf7795078f6517fddd00e88cec6c09', '2023-08-10T22:37:19Z']
['GladstoneBranch.svg', 'https://static.wikiforge.net/americanrailswiki/3/32/GladstoneBranch.svg', 'Matthew Wong', 4228, '78c334131415df073c7896a5c639187e49f35b16', '2023-07-21T18:13:33Z']
['MainLine.svg', 'https://static.wikiforge.net/americanrailswiki/1/1b/MainLine.svg', 'Matthew Wong', 10526, 'f815fdce77dfa4b08c0b71fae76d653a59baab58', '2023-07-21T18:07:53Z']
['MontclairBoontonLine.svg', 'https://static.wikiforge.net/americanrailswiki/6/65/MontclairBoontonLine.svg', 'Matthew Wong', 2560, '28eb65e5a11cf587558fd1a65cb10f2174929bda', '2023-07-21T18:09:49Z']
['MorristownLine.svg', 'https://static.wikiforge.net/americanrailswiki/1/19/MorristownLine.svg', 'Matthew Wong', 3894, '7bd581486a6c416cb3524884ed1548a781198f0f', '2023-07-21T18:11:59Z']
['NJ Transit Comet V Cabcar at Atlantic City Rail Terminal.jpeg', 'https://static.wikiforge.net/americanrailswiki/6/67/NJ_Transit_Comet_V_Cabcar_at_Atlantic_City_Rail_Terminal.jpeg', 'Matthew Wong', 808056, '941529fb7a9c20c8a4dda6301ad4b1deb63941d9', '2023-08-10T22:30:54Z']
['NorthJerseyCoastLine.svg', 'https://static.wikiforge.net/americanrailswiki/a/a1/NorthJerseyCoastLine.svg', 'Matthew Wong', 1946, 'e7375e9e922049ea88ef96548b439e1cc8830ada', '2023-07-21T18:17:42Z']
['Northbound train arriving at Absecon station.jpeg', 'https://static.wikiforge.net/americanrailswiki/7/73/Northbound_train_arriving_at_Absecon_station.jpeg', 'Matthew Wong', 3227094, '907e6fb7e7f78878aa69878508057b3b971d53b3', '2023-08-17T16:02:43Z']
['Northbound train at Absecon station.jpeg', 'https://static.wikiforge.net/americanrailswiki/e/e9/Northbound_train_at_Absecon_station.jpeg', 'Matthew Wong', 2642140, '4b6fbd68ade6eec062bdc292c2b43d4ac7dfa8df', '2023-08-17T16:02:50Z']
['NortheastCorridorLine.svg', 'https://static.wikiforge.net/americanrailswiki/a/ad/NortheastCorridorLine.svg', 'Matthew Wong', 2922, '5e14df1edf27cf76116403029d4117277f8a322a', '2023-07-21T18:16:22Z']
['PascackValleyLine.svg', 'https://static.wikiforge.net/americanrailswiki/f/fb/PascackValleyLine.svg', 'Matthew Wong', 2280, 'a2ac4434c1b05cf937adfb1b1a28bf702f6b1a4f', '2023-07-21T18:04:22Z']
['Platform and Train at Atlantic City Rail Terminal.jpeg', 'https://static.wikiforge.net/americanrailswiki/b/b2/Platform_and_Train_at_Atlantic_City_Rail_Terminal.jpeg', 'Matthew Wong', 642360, '781856ddd3e0a2f267bc08d3e93da70c2144e7ac', '2023-08-10T22:33:15Z']
['Platform at Absecon station looking north.jpeg', 'https://static.wikiforge.net/americanrailswiki/2/23/Platform_at_Absecon_station_looking_north.jpeg', 'Matthew Wong', 3666006, 'ecf141574c4a601fbc7c9981f592c89cab84e4c5', '2023-08-17T16:02:28Z']
['Platform at Absecon station looking south.jpeg', 'https://static.wikiforge.net/americanrailswiki/d/d5/Platform_at_Absecon_station_looking_south.jpeg', 'Matthew Wong', 2908211, 'a717158420a953287c90e71b40e2eea351aef57b', '2023-08-17T16:02:35Z']
['RaritanValleyLine.svg', 'https://static.wikiforge.net/americanrailswiki/3/34/RaritanValleyLine.svg', 'Matthew Wong', 3794, '770f8746f37eb727d3647efe0ec54274a0e80da1', '2023-07-21T18:25:11Z']
['Wiki.png', 'https://static.wikiforge.net/americanrailswiki/b/bc/Wiki.png', 'Amanda Catherine', 17752, 'd295492961d2d506639f681ac6a768d58739581a', '2023-07-15T20:50:02Z']
Image filenames and URLs saved at... americanrails.wikiforge.net_1_40-20230825-images.txt
Retrieving images...
Creating "americanrails.wikiforge.net_1_40-20230825-wikidump/images" directory
| 18=>AtlanticCityLine.svg
| 17=>BergenCountyLine.svg
| 16=>Concourse at Atlantic City Rail Terminal 1.jpeg
| 15=>Concourse at Atlantic City Rail Terminal 2.jpeg
| 14=>GladstoneBranch.svg
| 13=>MainLine.svg
| 12=>MontclairBoontonLine.svg
| 11=>MorristownLine.svg
| 10=>NJ Transit Comet V Cabcar at Atlantic City Rail Te
| 9=>NorthJerseyCoastLine.svg
| 8=>Northbound train arriving at Absecon station.jpeg
| 7=>Northbound train at Absecon station.jpeg
| 6=>NortheastCorridorLine.svg
| 5=>PascackValleyLine.svg
| 4=>Platform and Train at Atlantic City Rail Terminal.
| 3=>Platform at Absecon station looking north.jpeg
| 2=>Platform at Absecon station looking south.jpeg
| 1=>RaritanValleyLine.svg
| 0=>Wiki.png
Downloaded 19 files
Undo monkey patch...
Downloading index.php (Main Page) as index.html
Downloading Special:Version with extensions and other related info
Downloading site info as siteinfo.json
---> Done <---
If this is a public wiki, please, consider publishing this dump.
Do it yourself as explained in:
https://github.com/WikiTeam/wikiteam/wiki/Tutorial#Publishing_the_dump
Good luck! Bye!
----- Bot: Finished Task: WikiTeam3 -----
----- Bot: Task exit code: 0 -----
----- Bot: Starting Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
Note: 8 physical core(s) detected
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml : 11.71% ( 481 KiB => 56.3 KiB, /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst.tmp)
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 492618 bytes
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
Note: 8 physical core(s) detected
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt : 32.36% ( 3.69 KiB => 1.20 KiB, /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst.tmp)
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 3783 bytes
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI)
Scanning the drive:
1 folder, 19 files, 15468668 bytes (15 MiB)
Creating archive: /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/images.7z.tmp
Items to compress: 20
Files read from disk: 19
Archive size: 14901998 bytes (15 MiB)
Everything is Ok
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI)
Scanning the drive for archives:
1 file, 14901998 bytes (15 MiB)
Testing archive: /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
--
Path = /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
Type = 7z
Physical Size = 14901998
Headers Size = 683
Method = LZMA2:22
Solid = -
Blocks = 19
Everything is Ok
Folders: 1
Files: 19
Size: 15468668
Compressed: 14901998
Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True)
=== Loading config from /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump ===
Config(delay=0.0, retries=5, path='/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump', logs=False, date='20230825', index='https://americanrails.wikiforge.net/1.40/index.php', api='https://americanrails.wikiforge.net/1.40/api.php', xml=True, curonly=False, xmlapiexport=False, xmlrevisions=True, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False)
=== Preparing files to upload ===
=== commpressing necessary files: ===
=== Files already uploaded: ===
Already uploaded 0 files. (0 files in remote item in total)
=== Files to upload: ===
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/config.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/SpecialVersion.html"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/siteinfo.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/index.html"
"americanrails.wikiforge.net_1_40-20230825-history.xml.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst"
"americanrails.wikiforge.net_1_40-20230825-images.7z" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z"
7 files ready to upload...
=== Preparing metadata ===
=== Item metadata: ===
{
"collection": "opensource",
"description": "American Rails Wiki dumped with wikiteam3 tools.",
"language": "en",
"last-updated-date": "2023-08-25",
"licenseurl": "https://creativecommons.org/licenses/by-sa/4.0/",
"mediatype": "web",
"originalurl": "https://americanrails.wikiforge.net/1.40/api.php",
"rights": "Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)",
"scanner": "wikiteam3 (v4.0.18)",
"subject": "wiki; wikiteam; wikiteam3; MediaWiki; americanrails.wikiforge.net_1.40; American Rails Wiki",
"title": "Wiki - American Rails Wiki",
"upload-state": "uploading"
}
logo_url: https://static.wikiforge.net/americanrailswiki/b/bc/Wiki.png
=== Uploading ===
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 4.90MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 4.89MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:00<00:00, 4.30MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:00<00:00, 4.29MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.65MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.64MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.62MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.60MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.77MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.75MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:00<00:00, 5.86MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:00<00:00, 5.84MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 0%| | 0/15 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 7%|▋ | 1/15 [00:00<00:06, 2.31MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 33%|███▎ | 5/15 [00:00<00:00, 11.65MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 60%|██████ | 9/15 [00:00<00:00, 18.07MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 87%|████████▋ | 13/15 [00:00<00:00, 22.84MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 100%|██████████| 15/15 [00:00<00:00, 18.01MiB/s]
Uploading 7 files: Done.
Waiting for item to be created (400 tries left) ...
Waiting for item to be created (399 tries left) ...
Waiting for item to be created (398 tries left) ...
Waiting for item to be created (397 tries left) ...
Waiting for item to be created (396 tries left) ...
Waiting for item to be created (395 tries left) ...
Waiting for item to be created (394 tries left) ...
Waiting for item to be created (393 tries left) ...
Waiting for item to be created (392 tries left) ...
Waiting for item to be created (391 tries left) ...
Waiting for item to be created (390 tries left) ...
Waiting for item to be created (389 tries left) ...
Waiting for item to be created (388 tries left) ...
Waiting for item to be created (387 tries left) ...
Waiting for item to be created (386 tries left) ...
Waiting for item to be created (385 tries left) ...
Waiting for item to be created (384 tries left) ...
Waiting for item to be created (383 tries left) ...
Waiting for item to be created (382 tries left) ...
Waiting for item to be created (381 tries left) ...
Waiting for item to be created (380 tries left) ...
Waiting for item to be created (379 tries left) ...
Waiting for item to be created (378 tries left) ...
Waiting for item to be created (377 tries left) ...
Waiting for item to be created (376 tries left) ...
Waiting for item to be created (375 tries left) ...
Waiting for item to be created (374 tries left) ...
Waiting for item to be created (373 tries left) ...
Waiting for item to be created (372 tries left) ...
Waiting for item to be created (371 tries left) ...
Waiting for item to be created (370 tries left) ...
Waiting for item to be created (369 tries left) ...
Waiting for item to be created (368 tries left) ...
Waiting for item to be created (367 tries left) ...
Waiting for item to be created (366 tries left) ...
Waiting for item to be created (365 tries left) ...
Waiting for item to be created (364 tries left) ...
Waiting for item to be created (363 tries left) ...
Waiting for item to be created (362 tries left) ...
Waiting for item to be created (361 tries left) ...
Waiting for item to be created (360 tries left) ...
Waiting for item to be created (359 tries left) ...
Waiting for item to be created (358 tries left) ...
Waiting for item to be created (357 tries left) ...
Waiting for item to be created (356 tries left) ...
Waiting for item to be created (355 tries left) ...
Waiting for item to be created (354 tries left) ...
Waiting for item to be created (353 tries left) ...
Waiting for item to be created (352 tries left) ...
Waiting for item to be created (351 tries left) ...
Waiting for item to be created (350 tries left) ...
Waiting for item to be created (349 tries left) ...
Waiting for item to be created (348 tries left) ...
Waiting for item to be created (347 tries left) ...
Waiting for item to be created (346 tries left) ...
Waiting for item to be created (345 tries left) ...
Waiting for item to be created (344 tries left) ...
Waiting for item to be created (343 tries left) ...
Waiting for item to be created (342 tries left) ...
Waiting for item to be created (341 tries left) ...
Waiting for item to be created (340 tries left) ...
Waiting for item to be created (339 tries left) ...
Waiting for item to be created (338 tries left) ...
Waiting for item to be created (337 tries left) ...
Waiting for item to be created (336 tries left) ...
Waiting for item to be created (335 tries left) ...
Waiting for item to be created (334 tries left) ...
Waiting for item to be created (333 tries left) ...
Waiting for item to be created (332 tries left) ...
Waiting for item to be created (331 tries left) ...
Waiting for item to be created (330 tries left) ...
Waiting for item to be created (329 tries left) ...
Waiting for item to be created (328 tries left) ...
Waiting for item to be created (327 tries left) ...
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 536, in _make_request
response = conn.getresponse()
File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 461, in getresponse
httplib_response = super().getresponse()
File "/usr/lib/python3.10/http/client.py", line 1375, in getresponse
response.begin()
File "/usr/lib/python3.10/http/client.py", line 318, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.10/http/client.py", line 279, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.10/socket.py", line 705, in readinto
return self._sock.recv_into(b)
File "/usr/lib/python3.10/ssl.py", line 1274, in recv_into
return self.read(nbytes, buffer)
File "/usr/lib/python3.10/ssl.py", line 1130, in read
return self._sslobj.read(len, buffer)
TimeoutError: The read operation timed out
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 790, in urlopen
response = self._make_request(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 538, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 370, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='archive.org', port=443): Read timed out. (read timeout=12)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 844, in urlopen
retries = retries.increment(
File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ReadTimeoutError("HTTPSConnectionPool(host='archive.org', port=443): Read timed out. (read timeout=12)"))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 278, in get_metadata
resp = self.get(url, auth=s3_auth, **request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 540, in send
raise e
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 537, in send
reraise_modify(e, e.request.url, prepend=False) # type: ignore
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 534, in send
r = super().send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: (MaxRetryError('HTTPSConnectionPool(host=\'archive.org\', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ReadTimeoutError("HTTPSConnectionPool(host=\'archive.org\', port=443): Read timed out. (read timeout=12)"))'), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/wikiteam3uploader", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 512, in main
upload(arg)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 388, in upload
upload_main_resouces(item, filedict, metadata, ia_keys)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 478, in upload_main_resouces
item = get_item(identifier)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/api.py", line 120, in get_item
return archive_session.get_item(identifier, request_kwargs=request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 253, in get_item
item_metadata = self.get_metadata(identifier, request_kwargs) or {}
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 283, in get_metadata
raise type(exc)(error_msg)
requests.exceptions.ConnectionError: Error retrieving metadata from https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825, (MaxRetryError('HTTPSConnectionPool(host=\'archive.org\', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ReadTimeoutError("HTTPSConnectionPool(host=\'archive.org\', port=443): Read timed out. (read timeout=12)"))'), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
----- Bot: Finishing Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 492618 bytes
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 3783 bytes
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI)
Scanning the drive for archives:
1 file, 14901998 bytes (15 MiB)
Testing archive: /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
--
Path = /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
Type = 7z
Physical Size = 14901998
Headers Size = 683
Method = LZMA2:22
Solid = -
Blocks = 19
Everything is Ok
Folders: 1
Files: 19
Size: 15468668
Compressed: 14901998
Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True)
=== Loading config from /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump ===
Config(delay=0.0, retries=5, path='/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump', logs=False, date='20230825', index='https://americanrails.wikiforge.net/1.40/index.php', api='https://americanrails.wikiforge.net/1.40/api.php', xml=True, curonly=False, xmlapiexport=False, xmlrevisions=True, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False)
=== Preparing files to upload ===
=== commpressing necessary files: ===
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst already exists. Skip compressing.
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst already exists. Skip compressing.
=== Files already uploaded: ===
Already uploaded 0 files. (0 files in remote item in total)
=== Files to upload: ===
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/config.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/SpecialVersion.html"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/siteinfo.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/index.html"
"americanrails.wikiforge.net_1_40-20230825-history.xml.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst"
"americanrails.wikiforge.net_1_40-20230825-images.7z" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z"
7 files ready to upload...
=== Preparing metadata ===
=== Item metadata: ===
{
"collection": "opensource",
"description": "American Rails Wiki dumped with wikiteam3 tools.",
"language": "en",
"last-updated-date": "2023-08-25",
"licenseurl": "https://creativecommons.org/licenses/by-sa/4.0/",
"mediatype": "web",
"originalurl": "https://americanrails.wikiforge.net/1.40/api.php",
"rights": "Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)",
"scanner": "wikiteam3 (v4.0.18)",
"subject": "wiki; wikiteam; wikiteam3; MediaWiki; americanrails.wikiforge.net_1.40; American Rails Wiki",
"title": "Wiki - American Rails Wiki",
"upload-state": "uploading"
}
logo_url: https://static.wikiforge.net/americanrailswiki/b/bc/Wiki.png
=== Uploading ===
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 3.48MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 3.48MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:00<00:00, 4.75MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:00<00:00, 4.73MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.85MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.84MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.62MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.50MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.40MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.39MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:02<00:00, 2.98s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:02<00:00, 2.98s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 0%| | 0/15 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 7%|▋ | 1/15 [00:00<00:13, 1.07MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 13%|█▎ | 2/15 [00:01<00:11, 1.11MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 40%|████ | 6/15 [00:01<00:02, 4.28MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 67%|██████▋ | 10/15 [00:02<00:00, 7.82MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 100%|██████████| 15/15 [00:02<00:00, 12.80MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 100%|██████████| 15/15 [00:02<00:00, 6.80MiB/s]
Uploading 7 files: Done.
Waiting for item to be created (400 tries left) ...
Waiting for item to be created (399 tries left) ...
Waiting for item to be created (398 tries left) ...
Waiting for item to be created (397 tries left) ...
Waiting for item to be created (396 tries left) ...
Waiting for item to be created (395 tries left) ...
Waiting for item to be created (394 tries left) ...
Waiting for item to be created (393 tries left) ...
Waiting for item to be created (392 tries left) ...
Waiting for item to be created (391 tries left) ...
Waiting for item to be created (390 tries left) ...
Waiting for item to be created (389 tries left) ...
Waiting for item to be created (388 tries left) ...
Waiting for item to be created (387 tries left) ...
Waiting for item to be created (386 tries left) ...
Waiting for item to be created (385 tries left) ...
Waiting for item to be created (384 tries left) ...
Waiting for item to be created (383 tries left) ...
Waiting for item to be created (382 tries left) ...
Waiting for item to be created (381 tries left) ...
Waiting for item to be created (380 tries left) ...
Waiting for item to be created (379 tries left) ...
Waiting for item to be created (378 tries left) ...
Waiting for item to be created (377 tries left) ...
Waiting for item to be created (376 tries left) ...
Waiting for item to be created (375 tries left) ...
Waiting for item to be created (374 tries left) ...
Waiting for item to be created (373 tries left) ...
Waiting for item to be created (372 tries left) ...
Waiting for item to be created (371 tries left) ...
Waiting for item to be created (370 tries left) ...
Waiting for item to be created (369 tries left) ...
Waiting for item to be created (368 tries left) ...
Waiting for item to be created (367 tries left) ...
Waiting for item to be created (366 tries left) ...
Waiting for item to be created (365 tries left) ...
Waiting for item to be created (364 tries left) ...
Waiting for item to be created (363 tries left) ...
Waiting for item to be created (362 tries left) ...
Waiting for item to be created (361 tries left) ...
Waiting for item to be created (360 tries left) ...
Waiting for item to be created (359 tries left) ...
Waiting for item to be created (358 tries left) ...
Waiting for item to be created (357 tries left) ...
Waiting for item to be created (356 tries left) ...
Waiting for item to be created (355 tries left) ...
Waiting for item to be created (354 tries left) ...
Waiting for item to be created (353 tries left) ...
Waiting for item to be created (352 tries left) ...
Waiting for item to be created (351 tries left) ...
Waiting for item to be created (350 tries left) ...
Waiting for item to be created (349 tries left) ...
Waiting for item to be created (348 tries left) ...
Waiting for item to be created (347 tries left) ...
Waiting for item to be created (346 tries left) ...
Waiting for item to be created (345 tries left) ...
Waiting for item to be created (344 tries left) ...
Waiting for item to be created (343 tries left) ...
Waiting for item to be created (342 tries left) ...
Waiting for item to be created (341 tries left) ...
Waiting for item to be created (340 tries left) ...
Waiting for item to be created (339 tries left) ...
Waiting for item to be created (338 tries left) ...
Waiting for item to be created (337 tries left) ...
Waiting for item to be created (336 tries left) ...
Waiting for item to be created (335 tries left) ...
Waiting for item to be created (334 tries left) ...
Waiting for item to be created (333 tries left) ...
Waiting for item to be created (332 tries left) ...
Waiting for item to be created (331 tries left) ...
Waiting for item to be created (330 tries left) ...
Waiting for item to be created (329 tries left) ...
Waiting for item to be created (328 tries left) ...
Waiting for item to be created (327 tries left) ...
Waiting for item to be created (326 tries left) ...
Waiting for item to be created (325 tries left) ...
Waiting for item to be created (324 tries left) ...
Waiting for item to be created (323 tries left) ...
Waiting for item to be created (322 tries left) ...
Waiting for item to be created (321 tries left) ...
Waiting for item to be created (320 tries left) ...
Waiting for item to be created (319 tries left) ...
Waiting for item to be created (318 tries left) ...
Waiting for item to be created (317 tries left) ...
Waiting for item to be created (316 tries left) ...
Waiting for item to be created (315 tries left) ...
Waiting for item to be created (314 tries left) ...
urllib3.exceptions.ResponseError: too many 502 error responses
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 941, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 931, in urlopen
retries = retries.increment(method, url, response=response, _pool=self)
File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 278, in get_metadata
resp = self.get(url, auth=s3_auth, **request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 540, in send
raise e
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 537, in send
reraise_modify(e, e.request.url, prepend=False) # type: ignore
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 534, in send
r = super().send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 510, in send
raise RetryError(e, request=request)
requests.exceptions.RetryError: (MaxRetryError("HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))"), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/wikiteam3uploader", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 512, in main
upload(arg)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 388, in upload
upload_main_resouces(item, filedict, metadata, ia_keys)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 478, in upload_main_resouces
item = get_item(identifier)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/api.py", line 120, in get_item
return archive_session.get_item(identifier, request_kwargs=request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 253, in get_item
item_metadata = self.get_metadata(identifier, request_kwargs) or {}
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 283, in get_metadata
raise type(exc)(error_msg)
requests.exceptions.RetryError: Error retrieving metadata from https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825, (MaxRetryError("HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))"), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
----- Bot: Finishing Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 492618 bytes
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 3783 bytes
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI)
Scanning the drive for archives:
1 file, 14901998 bytes (15 MiB)
Testing archive: /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
--
Path = /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
Type = 7z
Physical Size = 14901998
Headers Size = 683
Method = LZMA2:22
Solid = -
Blocks = 19
Everything is Ok
Folders: 1
Files: 19
Size: 15468668
Compressed: 14901998
Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True)
=== Loading config from /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump ===
Config(delay=0.0, retries=5, path='/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump', logs=False, date='20230825', index='https://americanrails.wikiforge.net/1.40/index.php', api='https://americanrails.wikiforge.net/1.40/api.php', xml=True, curonly=False, xmlapiexport=False, xmlrevisions=True, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False)
=== Preparing files to upload ===
=== commpressing necessary files: ===
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst already exists. Skip compressing.
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst already exists. Skip compressing.
=== Files already uploaded: ===
Already uploaded 0 files. (0 files in remote item in total)
=== Files to upload: ===
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/config.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/SpecialVersion.html"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/siteinfo.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/index.html"
"americanrails.wikiforge.net_1_40-20230825-history.xml.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst"
"americanrails.wikiforge.net_1_40-20230825-images.7z" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z"
7 files ready to upload...
=== Preparing metadata ===
=== Item metadata: ===
{
"collection": "opensource",
"description": "American Rails Wiki dumped with wikiteam3 tools.",
"language": "en",
"last-updated-date": "2023-08-25",
"licenseurl": "https://creativecommons.org/licenses/by-sa/4.0/",
"mediatype": "web",
"originalurl": "https://americanrails.wikiforge.net/1.40/api.php",
"rights": "Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)",
"scanner": "wikiteam3 (v4.0.18)",
"subject": "wiki; wikiteam; wikiteam3; MediaWiki; americanrails.wikiforge.net_1.40; American Rails Wiki",
"title": "Wiki - American Rails Wiki",
"upload-state": "uploading"
}
logo_url: https://static.wikiforge.net/americanrailswiki/b/bc/Wiki.png
=== Uploading ===
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 5.71MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 5.69MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:01<00:00, 1.84s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:01<00:00, 1.84s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.74MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.74MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.27MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.26MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.37MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.33MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:00<00:00, 5.72MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:00<00:00, 5.70MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 0%| | 0/15 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 7%|▋ | 1/15 [00:00<00:13, 1.06MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 13%|█▎ | 2/15 [00:06<00:50, 3.91s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 20%|██ | 3/15 [00:10<00:44, 3.75s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 27%|██▋ | 4/15 [00:11<00:29, 2.69s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 33%|███▎ | 5/15 [00:12<00:20, 2.10s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 40%|████ | 6/15 [00:17<00:26, 2.99s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 47%|████▋ | 7/15 [00:18<00:18, 2.32s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 53%|█████▎ | 8/15 [00:18<00:12, 1.74s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 60%|██████ | 9/15 [00:19<00:07, 1.29s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 67%|██████▋ | 10/15 [00:19<00:04, 1.06MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 73%|███████▎ | 11/15 [00:19<00:02, 1.41MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 87%|████████▋ | 13/15 [00:27<00:04, 2.36s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 93%|█████████▎| 14/15 [00:28<00:01, 1.82s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 100%|██████████| 15/15 [00:30<00:00, 1.95s/MiB]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 100%|██████████| 15/15 [00:30<00:00, 2.03s/MiB]
Uploading 7 files: Done.
Waiting for item to be created (400 tries left) ...
Waiting for item to be created (399 tries left) ...
Waiting for item to be created (398 tries left) ...
Waiting for item to be created (397 tries left) ...
Waiting for item to be created (396 tries left) ...
Waiting for item to be created (395 tries left) ...
Waiting for item to be created (394 tries left) ...
Waiting for item to be created (393 tries left) ...
Waiting for item to be created (392 tries left) ...
Waiting for item to be created (391 tries left) ...
Waiting for item to be created (390 tries left) ...
Waiting for item to be created (389 tries left) ...
Waiting for item to be created (388 tries left) ...
Waiting for item to be created (387 tries left) ...
Waiting for item to be created (386 tries left) ...
Waiting for item to be created (385 tries left) ...
Waiting for item to be created (384 tries left) ...
Waiting for item to be created (383 tries left) ...
Waiting for item to be created (382 tries left) ...
Waiting for item to be created (381 tries left) ...
Waiting for item to be created (380 tries left) ...
Waiting for item to be created (379 tries left) ...
Waiting for item to be created (378 tries left) ...
Waiting for item to be created (377 tries left) ...
Waiting for item to be created (376 tries left) ...
Waiting for item to be created (375 tries left) ...
Waiting for item to be created (374 tries left) ...
Waiting for item to be created (373 tries left) ...
Waiting for item to be created (372 tries left) ...
Waiting for item to be created (371 tries left) ...
Waiting for item to be created (370 tries left) ...
Waiting for item to be created (369 tries left) ...
Waiting for item to be created (368 tries left) ...
Waiting for item to be created (367 tries left) ...
Waiting for item to be created (366 tries left) ...
Waiting for item to be created (365 tries left) ...
Waiting for item to be created (364 tries left) ...
Waiting for item to be created (363 tries left) ...
Waiting for item to be created (362 tries left) ...
Waiting for item to be created (361 tries left) ...
Waiting for item to be created (360 tries left) ...
Waiting for item to be created (359 tries left) ...
Waiting for item to be created (358 tries left) ...
Waiting for item to be created (357 tries left) ...
Waiting for item to be created (356 tries left) ...
Waiting for item to be created (355 tries left) ...
Waiting for item to be created (354 tries left) ...
Waiting for item to be created (353 tries left) ...
Waiting for item to be created (352 tries left) ...
Waiting for item to be created (351 tries left) ...
Waiting for item to be created (350 tries left) ...
Waiting for item to be created (349 tries left) ...
Waiting for item to be created (348 tries left) ...
Waiting for item to be created (347 tries left) ...
Waiting for item to be created (346 tries left) ...
Waiting for item to be created (345 tries left) ...
Waiting for item to be created (344 tries left) ...
Waiting for item to be created (343 tries left) ...
Waiting for item to be created (342 tries left) ...
Waiting for item to be created (341 tries left) ...
Waiting for item to be created (340 tries left) ...
Waiting for item to be created (339 tries left) ...
Waiting for item to be created (338 tries left) ...
Waiting for item to be created (337 tries left) ...
Waiting for item to be created (336 tries left) ...
Waiting for item to be created (335 tries left) ...
Waiting for item to be created (334 tries left) ...
Waiting for item to be created (333 tries left) ...
Waiting for item to be created (332 tries left) ...
Waiting for item to be created (331 tries left) ...
Waiting for item to be created (330 tries left) ...
Waiting for item to be created (329 tries left) ...
Waiting for item to be created (328 tries left) ...
Waiting for item to be created (327 tries left) ...
Waiting for item to be created (326 tries left) ...
Waiting for item to be created (325 tries left) ...
Waiting for item to be created (324 tries left) ...
Waiting for item to be created (323 tries left) ...
Waiting for item to be created (322 tries left) ...
Waiting for item to be created (321 tries left) ...
Waiting for item to be created (320 tries left) ...
Waiting for item to be created (319 tries left) ...
Waiting for item to be created (318 tries left) ...
urllib3.exceptions.ResponseError: too many 502 error responses
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 941, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 931, in urlopen
retries = retries.increment(method, url, response=response, _pool=self)
File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 278, in get_metadata
resp = self.get(url, auth=s3_auth, **request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 540, in send
raise e
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 537, in send
reraise_modify(e, e.request.url, prepend=False) # type: ignore
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 534, in send
r = super().send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 510, in send
raise RetryError(e, request=request)
requests.exceptions.RetryError: (MaxRetryError("HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))"), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/wikiteam3uploader", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 512, in main
upload(arg)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 388, in upload
upload_main_resouces(item, filedict, metadata, ia_keys)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 478, in upload_main_resouces
item = get_item(identifier)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/api.py", line 120, in get_item
return archive_session.get_item(identifier, request_kwargs=request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 253, in get_item
item_metadata = self.get_metadata(identifier, request_kwargs) or {}
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 283, in get_metadata
raise type(exc)(error_msg)
requests.exceptions.RetryError: Error retrieving metadata from https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825, (MaxRetryError("HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))"), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
----- Bot: Finishing Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 492618 bytes
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 3783 bytes
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI)
Scanning the drive for archives:
1 file, 14901998 bytes (15 MiB)
Testing archive: /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
--
Path = /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
Type = 7z
Physical Size = 14901998
Headers Size = 683
Method = LZMA2:22
Solid = -
Blocks = 19
Everything is Ok
Folders: 1
Files: 19
Size: 15468668
Compressed: 14901998
Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True)
=== Loading config from /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump ===
Config(delay=0.0, retries=5, path='/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump', logs=False, date='20230825', index='https://americanrails.wikiforge.net/1.40/index.php', api='https://americanrails.wikiforge.net/1.40/api.php', xml=True, curonly=False, xmlapiexport=False, xmlrevisions=True, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False)
=== Preparing files to upload ===
=== commpressing necessary files: ===
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst already exists. Skip compressing.
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst already exists. Skip compressing.
=== Files already uploaded: ===
Already uploaded 0 files. (0 files in remote item in total)
=== Files to upload: ===
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/config.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/SpecialVersion.html"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/siteinfo.json"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/index.html"
"americanrails.wikiforge.net_1_40-20230825-history.xml.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst"
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst"
"americanrails.wikiforge.net_1_40-20230825-images.7z" from "/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z"
7 files ready to upload...
=== Preparing metadata ===
=== Item metadata: ===
{
"collection": "opensource",
"description": "American Rails Wiki dumped with wikiteam3 tools.",
"language": "en",
"last-updated-date": "2023-08-25",
"licenseurl": "https://creativecommons.org/licenses/by-sa/4.0/",
"mediatype": "web",
"originalurl": "https://americanrails.wikiforge.net/1.40/api.php",
"rights": "Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)",
"scanner": "wikiteam3 (v4.0.18)",
"subject": "wiki; wikiteam; wikiteam3; MediaWiki; americanrails.wikiforge.net_1.40; American Rails Wiki",
"title": "Wiki - American Rails Wiki",
"upload-state": "uploading"
}
logo_url: https://static.wikiforge.net/americanrailswiki/b/bc/Wiki.png
=== Uploading ===
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 3.63MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json: 100%|██████████| 1/1 [00:00<00:00, 3.63MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:00<00:00, 4.51MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html: 100%|██████████| 1/1 [00:00<00:00, 4.50MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.87MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json: 100%|██████████| 1/1 [00:00<00:00, 3.86MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.65MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html: 100%|██████████| 1/1 [00:00<00:00, 5.63MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.25MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 100%|██████████| 1/1 [00:00<00:00, 5.24MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 0%| | 0/1 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:00<00:00, 5.13MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 100%|██████████| 1/1 [00:00<00:00, 5.11MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 0%| | 0/15 [00:00, ?MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 7%|▋ | 1/15 [00:00<00:06, 2.22MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 13%|█▎ | 2/15 [00:00<00:04, 2.94MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 20%|██ | 3/15 [00:00<00:03, 3.22MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 27%|██▋ | 4/15 [00:01<00:03, 3.41MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 33%|███▎ | 5/15 [00:01<00:04, 2.25MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 40%|████ | 6/15 [00:03<00:08, 1.03MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 47%|████▋ | 7/15 [00:04<00:06, 1.30MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 53%|█████▎ | 8/15 [00:04<00:04, 1.57MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 60%|██████ | 9/15 [00:05<00:03, 1.82MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 67%|██████▋ | 10/15 [00:05<00:02, 2.02MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 73%|███████▎ | 11/15 [00:05<00:01, 2.16MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 80%|████████ | 12/15 [00:06<00:01, 2.03MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 87%|████████▋ | 13/15 [00:06<00:00, 2.06MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 93%|█████████▎| 14/15 [00:07<00:00, 2.01MiB/s]
uploading americanrails.wikiforge.net_1_40-20230825-images.7z: 100%|██████████| 15/15 [00:07<00:00, 2.03MiB/s]
Uploading 7 files: Done.
Waiting for item to be created (400 tries left) ...
Waiting for item to be created (399 tries left) ...
Waiting for item to be created (398 tries left) ...
Waiting for item to be created (397 tries left) ...
Waiting for item to be created (396 tries left) ...
Waiting for item to be created (395 tries left) ...
Waiting for item to be created (394 tries left) ...
Waiting for item to be created (393 tries left) ...
Waiting for item to be created (392 tries left) ...
Waiting for item to be created (391 tries left) ...
Waiting for item to be created (390 tries left) ...
Waiting for item to be created (389 tries left) ...
Waiting for item to be created (388 tries left) ...
Waiting for item to be created (387 tries left) ...
Waiting for item to be created (386 tries left) ...
Waiting for item to be created (385 tries left) ...
Waiting for item to be created (384 tries left) ...
Waiting for item to be created (383 tries left) ...
Waiting for item to be created (382 tries left) ...
Waiting for item to be created (381 tries left) ...
Waiting for item to be created (380 tries left) ...
Waiting for item to be created (379 tries left) ...
Waiting for item to be created (378 tries left) ...
Waiting for item to be created (377 tries left) ...
Waiting for item to be created (376 tries left) ...
Waiting for item to be created (375 tries left) ...
Waiting for item to be created (374 tries left) ...
Waiting for item to be created (373 tries left) ...
Waiting for item to be created (372 tries left) ...
Waiting for item to be created (371 tries left) ...
Waiting for item to be created (370 tries left) ...
Waiting for item to be created (369 tries left) ...
Waiting for item to be created (368 tries left) ...
Waiting for item to be created (367 tries left) ...
Waiting for item to be created (366 tries left) ...
Waiting for item to be created (365 tries left) ...
Waiting for item to be created (364 tries left) ...
Waiting for item to be created (363 tries left) ...
Waiting for item to be created (362 tries left) ...
Waiting for item to be created (361 tries left) ...
Waiting for item to be created (360 tries left) ...
Waiting for item to be created (359 tries left) ...
Waiting for item to be created (358 tries left) ...
Waiting for item to be created (357 tries left) ...
Waiting for item to be created (356 tries left) ...
Waiting for item to be created (355 tries left) ...
Waiting for item to be created (354 tries left) ...
Waiting for item to be created (353 tries left) ...
Waiting for item to be created (352 tries left) ...
Waiting for item to be created (351 tries left) ...
Waiting for item to be created (350 tries left) ...
Waiting for item to be created (349 tries left) ...
Waiting for item to be created (348 tries left) ...
Waiting for item to be created (347 tries left) ...
Waiting for item to be created (346 tries left) ...
Waiting for item to be created (345 tries left) ...
Waiting for item to be created (344 tries left) ...
Waiting for item to be created (343 tries left) ...
Waiting for item to be created (342 tries left) ...
Waiting for item to be created (341 tries left) ...
Waiting for item to be created (340 tries left) ...
Waiting for item to be created (339 tries left) ...
Waiting for item to be created (338 tries left) ...
Waiting for item to be created (337 tries left) ...
Waiting for item to be created (336 tries left) ...
Waiting for item to be created (335 tries left) ...
Waiting for item to be created (334 tries left) ...
Waiting for item to be created (333 tries left) ...
Waiting for item to be created (332 tries left) ...
Waiting for item to be created (331 tries left) ...
Waiting for item to be created (330 tries left) ...
Waiting for item to be created (329 tries left) ...
Waiting for item to be created (328 tries left) ...
Waiting for item to be created (327 tries left) ...
Waiting for item to be created (326 tries left) ...
Waiting for item to be created (325 tries left) ...
Waiting for item to be created (324 tries left) ...
Waiting for item to be created (323 tries left) ...
Waiting for item to be created (322 tries left) ...
Waiting for item to be created (321 tries left) ...
Waiting for item to be created (320 tries left) ...
Waiting for item to be created (319 tries left) ...
Waiting for item to be created (318 tries left) ...
Waiting for item to be created (317 tries left) ...
Waiting for item to be created (316 tries left) ...
Waiting for item to be created (315 tries left) ...
Waiting for item to be created (314 tries left) ...
Waiting for item to be created (313 tries left) ...
Waiting for item to be created (312 tries left) ...
Waiting for item to be created (311 tries left) ...
Waiting for item to be created (310 tries left) ...
Waiting for item to be created (309 tries left) ...
urllib3.exceptions.ResponseError: too many 502 error responses
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 941, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 941, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 874, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 931, in urlopen
retries = retries.increment(method, url, response=response, _pool=self)
File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 278, in get_metadata
resp = self.get(url, auth=s3_auth, **request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 540, in send
raise e
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 537, in send
reraise_modify(e, e.request.url, prepend=False) # type: ignore
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 534, in send
r = super().send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 510, in send
raise RetryError(e, request=request)
requests.exceptions.RetryError: (MaxRetryError("HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))"), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/wikiteam3uploader", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 512, in main
upload(arg)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 388, in upload
upload_main_resouces(item, filedict, metadata, ia_keys)
File "/usr/local/lib/python3.10/dist-packages/wikiteam3/uploader/uploader.py", line 478, in upload_main_resouces
item = get_item(identifier)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/api.py", line 120, in get_item
return archive_session.get_item(identifier, request_kwargs=request_kwargs)
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 253, in get_item
item_metadata = self.get_metadata(identifier, request_kwargs) or {}
File "/usr/local/lib/python3.10/dist-packages/internetarchive/session.py", line 283, in get_metadata
raise type(exc)(error_msg)
requests.exceptions.RetryError: Error retrieving metadata from https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825, (MaxRetryError("HTTPSConnectionPool(host='archive.org', port=443): Max retries exceeded with url: /metadata/wiki-americanrails.wikiforge.net_1_40-20230825 (Caused by ResponseError('too many 502 error responses'))"), 'https://archive.org/metadata/wiki-americanrails.wikiforge.net_1_40-20230825')
----- Bot: Finishing Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
----- Bot: Starting Task: Uploader Pseudo Task -----
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst: 492618 bytes
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***
/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst: 3783 bytes
7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI)
Scanning the drive for archives:
1 file, 14901998 bytes (15 MiB)
Testing archive: /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
--
Path = /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.7z
Type = 7z
Physical Size = 14901998
Headers Size = 683
Method = LZMA2:22
Solid = -
Blocks = 19
Everything is Ok
Folders: 1
Files: 19
Size: 15468668
Compressed: 14901998
Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True)
=== Loading config from /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump ===
Config(delay=0.0, retries=5, path='/root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump', logs=False, date='20230825', index='https://americanrails.wikiforge.net/1.40/index.php', api='https://americanrails.wikiforge.net/1.40/api.php', xml=True, curonly=False, xmlapiexport=False, xmlrevisions=True, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False)
=== Preparing files to upload ===
=== commpressing necessary files: ===
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-history.xml.zst already exists. Skip compressing.
File /root/wikibot/jobs/13a26007-4949-441a-8561-060e1da2d2cf/americanrails.wikiforge.net_1_40-20230825-wikidump/americanrails.wikiforge.net_1_40-20230825-images.txt.zst already exists. Skip compressing.
=== Files already uploaded: ===
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/SpecialVersion.html" (already uploaded)
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/americanrails.wikiforge.net_1_40-20230825-images.txt.zst" (already uploaded)
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/config.json" (already uploaded)
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/index.html" (already uploaded)
"americanrails.wikiforge.net_1_40-20230825-dumpMeta/siteinfo.json" (already uploaded)
"americanrails.wikiforge.net_1_40-20230825-history.xml.zst" (already uploaded)
"americanrails.wikiforge.net_1_40-20230825-images.7z" (already uploaded)
Already uploaded 7 files. (11 files in remote item in total)
=== Files to upload: ===
0 files ready to upload...
=== Preparing metadata ===
=== Item metadata: ===
{
"collection": "opensource",
"description": "American Rails Wiki dumped with wikiteam3 tools.",
"language": "en",
"last-updated-date": "2023-09-16",
"licenseurl": "https://creativecommons.org/licenses/by-sa/4.0/",
"mediatype": "web",
"originalurl": "https://americanrails.wikiforge.net/1.40/api.php",
"rights": "Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)",
"scanner": "wikiteam3 (v4.1.1)",
"subject": "wiki; wikiteam; wikiteam3; MediaWiki; americanrails.wikiforge.net_1.40; American Rails Wiki",
"title": "Wiki - American Rails Wiki",
"upload-state": "uploading"
}
logo_url: https://static.wikiforge.net/americanrailswiki/b/bc/Wiki.png
=== Uploading ===
Uploading 0 files: Done.
=== Uploading logo (optional) ===
uploading wiki-americanrails.wikiforge.net_1_40-20230825_logo.png: 0%| | 0/1 [00:00, ?MiB/s]
uploading wiki-americanrails.wikiforge.net_1_40-20230825_logo.png: 100%|██████████| 1/1 [00:00<00:00, 5.09MiB/s]
uploading wiki-americanrails.wikiforge.net_1_40-20230825_logo.png: 100%|██████████| 1/1 [00:00<00:00, 5.08MiB/s]
=== Updating upload-state ===
{"success":true,"task_id":3880141815,"log":"https://catalogd.archive.org/log/3880141815"}
=== Uploading complete ===
identifier: wiki-americanrails.wikiforge.net_1_40-20230825
URL: https://archive.org/details/wiki-americanrails.wikiforge.net_1_40-20230825
----- Bot: Finishing Task: Uploader Pseudo Task -----