----- Bot: Starting Task: WikiTeam3 ----- ----- Bot: Command: wikiteam3dumpgenerator --xml --images --xmlapiexport https://wiki.xmltv.org ----- No suitable dump found at Internet Archive Checking API... https://wiki.xmltv.org/api.php API is OK: https://wiki.xmltv.org/api.php Checking index.php... https://wiki.xmltv.org/index.php index.php is OK No --path argument provided. Defaulting to: [working_directory]/[domain_prefix]-[date]-wikidump Which expands to: ./wiki.xmltv.org-20230905-wikidump --delay is the default value of 1.5 There will be a 1.5 second delay between HTTP calls in order to keep the server from timing you out. If you know that this is unnecessary, you can manually specify '--delay 0.0'. ######################################################################### # Welcome to DumpGenerator 4.0.18 by WikiTeam3 (GPL v3) # # More info at: https://github.com/saveweb/wikiteam3 # # Copyright (C) 2011-2023 WikiTeam developers # ######################################################################### Analysing https://wiki.xmltv.org/api.php Trying generating a new dump into a new directory... https://wiki.xmltv.org/api.php Getting the XML header from the API Retrieving the XML for every page from the beginning Retrieving the XML for every page Loading page titles from namespaces = all Excluding titles from namespaces = None Delay 1.5s. 16 namespaces found Retrieving titles in the namespace 0 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 1 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 2 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 3 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 4 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 5 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 6 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 7 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 8 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 9 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 10 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 11 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 12 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 13 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 14 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Retrieving titles in the namespace 15 Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Delay 1.5s: Session delay: wikiteam3.dumpgenerator.api.page_titles . Undo monkey patch... Titles saved at... wiki.xmltv.org-20230905-titles.txt 108 page titles loaded Delay 1.5s. AutoEpg, 67 edits Delay 1.5s. BBC Backstage, 7 edits Delay 1.5s. Belgium and Luxembourg, 7 edits Delay 1.5s. Brazil, 7 edits Delay 1.5s. Britain and Ireland, 7 edits Delay 1.5s. EU epgdata, 10 edits Delay 1.5s. Europe, 10 edits Delay 1.5s. France, 2 edits Delay 1.5s. HowToMakeARelease, 1 edit Delay 1.5s. -> Downloaded 10 pages HowtoSubmitAGrabber, 2 edits Delay 1.5s. HowtoUseGrabbers, 2 edits Delay 1.5s. HowtoWriteAGrabber, 10 edits Delay 1.5s. Hungary and Romania, 3 edits Delay 1.5s. ICalendar, 2 edits Delay 1.5s. LineupProposal, 8 edits Delay 1.5s. LineupProposal2, 66 edits Delay 1.5s. Living on the Edge, 5 edits Delay 1.5s. Main Page, 69 edits Delay 1.5s. Main Page/, 1 edit Delay 1.5s. -> Downloaded 20 pages Main Page/howtowriteagrabber.html, 1 edit Delay 1.5s. Main Page/lineupproposal2.html, 1 edit Delay 1.5s. Main Page/xmltvcapabilities.html, 1 edit Delay 1.5s. Main Page/xmltvfileformat.html, 1 edit Delay 1.5s. Netherlands, 12 edits Delay 1.5s. NoLineupProposal, 7 edits Delay 1.5s. NonameTV, 2 edits Delay 1.5s. North America, 3 edits Delay 1.5s. Portugal, 10 edits Delay 1.5s. RFC 2838, 1 edit Delay 1.5s. -> Downloaded 30 pages RFC 4078, 1 edit Delay 1.5s. ReplayTV, 19 edits Delay 1.5s. ReplayTV-FREESCO, 11 edits Delay 1.5s. ReplayTV-FreeSCO, 1 edit Delay 1.5s. ReplayTV-FreeSCO-brief, 5 edits Delay 1.5s. ReplayTV2, 6 edits Delay 1.5s. Sandbox, 2 edits Delay 1.5s. Supplementary Files, 1 edit Delay 1.5s. Switzerland, 1 edit Delay 1.5s. TV CHECK, 1 edit Delay 1.5s. -> Downloaded 40 pages Tv check, 10 edits Delay 1.5s. Tv find grabbers, 1 edit Delay 1.5s. Tv grab eu epgdata, 1 edit Delay 1.5s. Tv grab uk bbcbackstage, 2 edits Delay 1.5s. WillerZ, 1 edit Delay 1.5s. XMLTVFormat, 6 edits Delay 1.5s. XMLTVProject, 42 edits Delay 1.5s. XMLTVProjectDownload, 11 edits Delay 1.5s. XMLTVWindowsBuild, 15 edits Delay 1.5s. XMLTVexeBuild, 8 edits Delay 1.5s. -> Downloaded 50 pages XmltvCapabilities, 9 edits Delay 1.5s. XmltvFormat, 1 edit Delay 1.5s. XmltvRelatedProjects, 68 edits Delay 1.5s. XmltvStatus, 3 edits Delay 1.5s. XmltvTestCodes, 7 edits Delay 1.5s. XmltvUnrelatedProjects, 4 edits Delay 1.5s. XmltvValidation, 3 edits Delay 1.5s. XmltvWindowsExecutable, 2 edits Delay 1.5s. XmltvWorldDomination, 19 edits Delay 1.5s. Talk:Hungary and Romania, 3 edits Delay 1.5s. -> Downloaded 60 pages Talk:LineupProposal, 2 edits Delay 1.5s. Talk:Main Page, 2 edits Delay 1.5s. Talk:ReplayTV-FREESCO, 3 edits Delay 1.5s. Talk:Tv grab dvb plus, 1 edit Delay 1.5s. Talk:XMLTVModule, 1 edit Delay 1.5s. Talk:XMLTVProject, 3 edits Delay 1.5s. Talk:XmltvWorldDomination, 2 edits Delay 1.5s. User:Compcyz, 1 edit Delay 1.5s. User:Dekarl, 44 edits Delay 1.5s. User:Dekarl/Static File Grabber Template, 3 edits Delay 1.5s. -> Downloaded 70 pages User:Hcvst, 7 edits Delay 1.5s. User:Jamesj, 5 edits Delay 1.5s. User:MattiasHolmlund, 1 edit Delay 1.5s. User:Pgbennett, 1 edit Delay 1.5s. User:Procadworks, 2 edits Delay 1.5s. User:Rmeden, 1 edit Delay 1.5s. User:WikiSysop, 1 edit Delay 1.5s. User:WillerZ, 5 edits Delay 1.5s. User talk:Amblinn, 60 edits Delay 1.5s. User talk:Bilbo uk, 1 edit Delay 1.5s. -> Downloaded 80 pages User talk:Compcyz, 2 edits Delay 1.5s. User talk:DaveatIceTV, 1 edit Delay 1.5s. User talk:Dekarl, 2 edits Delay 1.5s. User talk:Essandess, 1 edit Delay 1.5s. User talk:Hika, 1 edit Delay 1.5s. User talk:Jnylen, 1 edit Delay 1.5s. User talk:Matt, 1 edit Delay 1.5s. User talk:Mbarry, 1 edit Delay 1.5s. User talk:Ntr9h, 1 edit Delay 1.5s. User talk:Pgbennett, 1 edit Delay 1.5s. -> Downloaded 90 pages User talk:Raboof, 1 edit Delay 1.5s. User talk:Rmeden, 3 edits Delay 1.5s. User talk:Stamata, 1 edit Delay 1.5s. User talk:The Robman, 1 edit Delay 1.5s. User talk:Uktvfrance, 1 edit Delay 1.5s. User talk:VERGARA, 2 edits Delay 1.5s. File:Chart.png, 1 edit Delay 1.5s. File:Tv check doc.jpg, 1 edit Delay 1.5s. MediaWiki:Requestaccount-text, 1 edit Delay 1.5s. MediaWiki:Sidebar, 12 edits Delay 1.5s. -> Downloaded 100 pages Template:Candidate for deletion, 1 edit Delay 1.5s. Template:Grabber, 4 edits Delay 1.5s. Template:Infobox grabber, 11 edits Delay 1.5s. Template:Manpage, 5 edits Delay 1.5s. Template:Program, 1 edit Delay 1.5s. Template:Third-party tool, 1 edit Delay 1.5s. Template:Ticket, 4 edits Delay 1.5s. Help:Editing, 1 edit Delay 1.5s. Category:Grabbers, 1 edit XML dump saved at... wiki.xmltv.org-20230905-history.xml )Retrieving image filenames Using API to retrieve image names... Using API:Allimages to get the list of images, 0 images found so far... Delay 1.5s. 2 Found 2 images Sorting image filenames 2 image names loaded ['Chart.png', 'https://wiki.xmltv.org/images/e/e8/Chart.png', 'Rmeden', 16697, 'e73aa1ea6b8dfca6d5b739fd55a763fa05310467', '2010-12-28T05:45:00Z'] ['Tv check doc.jpg', 'https://wiki.xmltv.org/images/8/86/Tv_check_doc.jpg', 'Jamesj', 34594, '2d83e60ef2e1dfc277b00c7d4f9dba135d160c7f', '2008-07-16T16:05:04Z'] Image filenames and URLs saved at... wiki.xmltv.org-20230905-images.txt Retrieving images... Creating "wiki.xmltv.org-20230905-wikidump/images" directory Delay 1.5s. Failled to donwload 'Chart.png' with URL 'https://wiki.xmltv.org/images/e/e8/Chart.png' due to HTTP '404', skipping | 2=>Chart.png Delay 1.5s. | 1=>Tv check doc.jpg Downloaded 1 files Undo monkey patch... Downloading index.php (Main Page) as index.html Delay 1.5s. Downloading Special:Version with extensions and other related info Delay 1.5s. Downloading site info as siteinfo.json Delay 1.5s. ---> Done <--- If this is a public wiki, please, consider publishing this dump. Do it yourself as explained in: https://github.com/WikiTeam/wikiteam/wiki/Tutorial#Publishing_the_dump Good luck! Bye! ----- Bot: Finished Task: WikiTeam3 ----- ----- Bot: Task exit code: 0 ----- ----- Bot: Starting Task: Uploader Pseudo Task ----- ----- Bot: Starting Task: Uploader Pseudo Task ----- *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** Note: 8 physical core(s) detected /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-titles.txt : 46.63% ( 1.82 KiB => 871 B, /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-titles.txt.zst.tmp) *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-titles.txt.zst: 1868 bytes *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** Note: 8 physical core(s) detected /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-history.xml : 2.43% ( 4.37 MiB => 109 KiB, /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-history.xml.zst.tmp) *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-history.xml.zst: 4585492 bytes *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** Note: 8 physical core(s) detected /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-images.txt : 74.02% ( 281 B => 208 B, /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-images.txt.zst.tmp) *** Zstandard CLI (64-bit) v1.5.5, by Yann Collet *** /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-images.txt.zst: 281 bytes 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI) Scanning the drive: 1 folder, 1 file, 34594 bytes (34 KiB) Creating archive: /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/images.7z.tmp Items to compress: 2 Files read from disk: 1 Archive size: 29096 bytes (29 KiB) Everything is Ok 7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,8 CPUs AMD EPYC 7282 16-Core Processor (830F10),ASM,AES-NI) Scanning the drive for archives: 1 file, 29096 bytes (29 KiB) Testing archive: /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-images.7z -- Path = /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-images.7z Type = 7z Physical Size = 29096 Headers Size = 190 Method = LZMA2:48k Solid = - Blocks = 1 Everything is Ok Folders: 1 Files: 1 Size: 34594 Compressed: 29096 Args(keys_file=PosixPath('/root/.doku_uploader_ia_keys'), collection='opensource', dry_run=False, update=False, wikidump_dir=PosixPath('/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump'), bin_zstd='zstd', zstd_level=22, bin_7z='7z', parallel=True) === Loading config from /root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump === Config(delay=1.5, retries=5, path='/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump', logs=False, date='20230905', index='https://wiki.xmltv.org/index.php', api='https://wiki.xmltv.org/api.php', xml=True, curonly=False, xmlapiexport=True, xmlrevisions=False, xmlrevisions_page=False, images=True, namespaces=['all'], exnamespaces=[], api_chunksize=50, export='', http_method='POST', failfast=False, templates=False) === Preparing files to upload === === commpressing necessary files: === === Files already uploaded: === Already uploaded 0 files. (0 files in remote item in total) === Files to upload: === "wiki.xmltv.org-20230905-dumpMeta/config.json" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/config.json" "wiki.xmltv.org-20230905-dumpMeta/errors.log" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/errors.log" "wiki.xmltv.org-20230905-dumpMeta/SpecialVersion.html" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/SpecialVersion.html" "wiki.xmltv.org-20230905-dumpMeta/siteinfo.json" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/siteinfo.json" "wiki.xmltv.org-20230905-dumpMeta/index.html" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/index.html" "wiki.xmltv.org-20230905-dumpMeta/wiki.xmltv.org-20230905-titles.txt.zst" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-titles.txt.zst" "wiki.xmltv.org-20230905-history.xml.zst" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-history.xml.zst" "wiki.xmltv.org-20230905-dumpMeta/wiki.xmltv.org-20230905-images.txt.zst" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-images.txt.zst" "wiki.xmltv.org-20230905-images.7z" from "/root/wikibot/jobs/72274b63-20c8-4855-9ca4-5979a81aa871/wiki.xmltv.org-20230905-wikidump/wiki.xmltv.org-20230905-images.7z" 9 files ready to upload... === Preparing metadata === === Item metadata: === { "collection": "opensource", "description": "XMLTV dumped with wikiteam3 tools.", "language": "en", "last-updated-date": "2023-09-05", "licenseurl": null, "mediatype": "web", "originalurl": "https://wiki.xmltv.org/api.php", "rights": null, "scanner": "wikiteam3 (v4.0.18)", "subject": "wiki; wikiteam; wikiteam3; MediaWiki; wiki.xmltv.org; XMLTV; unknowncopyright", "title": "Wiki - XMLTV", "upload-state": "uploading" } logo_url: None === Uploading === uploading wiki.xmltv.org-20230905-dumpMeta/config.json: 0%| | 0/1 [00:00