Commons talk:Video2commons
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 10 days and sections whose most recent comment is older than 365 days. For the archive overview, see Special:PrefixIndex/Commons talk:Video2commons/Archive. | |
Before you file a report, please check if the following list already includes the problem you have.
Known bugs and common errors
- Subtitles are not imported https://github.com/toolforge/video2commons/issues/148
- Since circa 2020, subtitles have not been automatically imported even if the option is selected. Unknown cause, possibly bug in codes. Previous discussions: Commons_talk:Video2commons/Archive_2#Youtube_subtitle_not_imported Commons_talk:Video2commons/Archive_2#Not_importing_subtitles_from_youtube.--RZuo (talk) 17:04, 1 January 2023 (UTC)
File not found[edit]
I am trying to upload from the disk and I am receiving an error File not found. How to debug? --Juandev (talk) 09:30, 3 June 2022 (UTC)
- The maintainer of v2c seems to have left. So proably there is no way to debug. You could say the file size and file type, also if the filename contains "funny" characters and the encoding and encoder of the file. you could upload a screenshot of the error. You could encode the file to webm (vp9) locally and upload with another upload tool. C.Suthorn (talk) 12:19, 3 June 2022 (UTC)
I'm getting Error: An exception occurred: FileNotFoundError: b"[Errno 2] No such file or directory: '/data/project/video2commons/video2commons/frontend/static/uploads/cf3490de-c6a9-11ed-8805-12dffaea8a17'"
on a file called "Racehorse Falls 01.mp4". No "funny" filenames there. 9 seconds of video, 15.4MB. - Jmabel ! talk 23:03, 19 March 2023 (UTC)
Error uploading file from computer[edit]
Good day. I am trying to upload a mp4 video (502 Mb) from my local PC, but no matter what I try I keep getting the error "Error: An exception occurred: FileNotFoundError: b"[Errno 2] No such file or directory: '/data/project/video2commons/video2commons/frontend/static/uploads/66607222-03a3-11ed-921f-82d0630f66a4'" during the upload process. Anyone understand this error and how to get around it? — Huntster (t @ c) 18:42, 14 July 2022 (UTC)
- This may be a temporary malfunction of the tool. Otherwise only the maintainer of v2c can fix it. If you want to get the file uploaded soon, your best bet would be to transcode the file to webm locally, than upload with any other tool. --C.Suthorn (talk) 19:24, 14 July 2022 (UTC)
- Yeah, hopefully that's the case. Unfortunately uploading locally doesn't seem to be an option either; I have a webm version of the file, and Upload Wizard errors out as well. Oh well. — Huntster (t @ c) 21:30, 14 July 2022 (UTC)
- @Huntster: A MW-server has been restarted. Uploading with Upload Wizard should work again. --C.Suthorn (talk) 06:38, 15 July 2022 (UTC)
- Yep, converted one of the files last night. Thanks for the update. Btw, do you know if the 4Gb upload limit imposed by Chunked also applies to this tool? — Huntster (t @ c) 14:18, 15 July 2022 (UTC)
- @Huntster: I believe that is imposed by the backend filesystem. — Jeff G. ツ please ping or talk to me 16:24, 15 July 2022 (UTC)
- Thanks, Jeff! — Huntster (t @ c) 16:28, 15 July 2022 (UTC)
- Actually the limit is imposed by the MW database storing file size as a 32bit unsigned integer value (=4GiB). The whole DB scheme of MW needs to be evaluated/changed (to 64bit integer for file size) to overcome this limit. --C.Suthorn (talk) 04:32, 16 July 2022 (UTC)
- Very interesting. Has there been any serious consideration express by WM toward updating to 64 bit? — Huntster (t @ c) 06:18, 16 July 2022 (UTC)
- @Huntster: I don't know. Considering by Commons:Village_pump#MP4_patents_expiration_date, user:Donald Trungs remark about MP4, I doubt that there will be done something soon. However the Offroader upload tool splits video files into parts of less than 4GiB before upload. --C.Suthorn (talk) 12:57, 18 July 2022 (UTC)
- That's very true. The lack of Foundation support for things like this is frustrating, considering MP4 being the dominant video format and the resources required to properly convert to another format. Offroader looks very useful but I don't use a mobile device for editing or for file storage. Insert sadface. — Huntster (t @ c) 17:26, 18 July 2022 (UTC)
- @Huntster: I don't know. Considering by Commons:Village_pump#MP4_patents_expiration_date, user:Donald Trungs remark about MP4, I doubt that there will be done something soon. However the Offroader upload tool splits video files into parts of less than 4GiB before upload. --C.Suthorn (talk) 12:57, 18 July 2022 (UTC)
- Very interesting. Has there been any serious consideration express by WM toward updating to 64 bit? — Huntster (t @ c) 06:18, 16 July 2022 (UTC)
- Actually the limit is imposed by the MW database storing file size as a 32bit unsigned integer value (=4GiB). The whole DB scheme of MW needs to be evaluated/changed (to 64bit integer for file size) to overcome this limit. --C.Suthorn (talk) 04:32, 16 July 2022 (UTC)
- Thanks, Jeff! — Huntster (t @ c) 16:28, 15 July 2022 (UTC)
- @Huntster: I believe that is imposed by the backend filesystem. — Jeff G. ツ please ping or talk to me 16:24, 15 July 2022 (UTC)
- Unfortunately, getting the same error again. If restarting the MW server is what fixes this, would it be possible to create a regular restart schedule? — Huntster (t @ c) 22:49, 26 August 2022 (UTC)
- Yep, converted one of the files last night. Thanks for the update. Btw, do you know if the 4Gb upload limit imposed by Chunked also applies to this tool? — Huntster (t @ c) 14:18, 15 July 2022 (UTC)
- @Huntster: A MW-server has been restarted. Uploading with Upload Wizard should work again. --C.Suthorn (talk) 06:38, 15 July 2022 (UTC)
- Yeah, hopefully that's the case. Unfortunately uploading locally doesn't seem to be an option either; I have a webm version of the file, and Upload Wizard errors out as well. Oh well. — Huntster (t @ c) 21:30, 14 July 2022 (UTC)
An exception occurred[edit]
I got the message Full Flight ATR72 600 - Real Pilot EYE POV GoPro - Cockpit video - Garuda-Indonesia An exception occurred: DownloadError: b'ERROR: giving up after 10 retries' while trying to upload [1]. Yann (talk) 16:58, 21 November 2022 (UTC)
Again now: Error: An exception occurred: FileNotFoundError: b"[Errno 2] No such file or directory: '/data/project/video2commons/video2commons/frontend/static/uploads/3d501b24-7cb8-11ed-8b57-66fb5a932327'" Yann (talk) 20:42, 15 December 2022 (UTC)
Error: An exception occurred: APIError: b'toomanyvalues: Too many values supplied for parameter "url"[edit]
I get this error: Error: An exception occurred: APIError: b'toomanyvalues: Too many values supplied for parameter "url". The limit is 50.\n[limit: 50;\n lowlimit: 50;\n highlimit: 500;\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]'
I'm trying to import the audio from this YouTube video. Vera (talk) 20:28, 1 January 2023 (UTC)
TypeError: b 'NoneType' object is not iterable[edit]
Hi, I saw a new (to me) error: An exception occurred: TypeError: b"'NoneType' object is not iterable"
Context/Reproduction-steps: I was trying to upload a file from GoogleDrive, if that's relevant? It initially recognized the file-type, and let me fill in the {information} box, but then once it was in the 2nd-step on the Task screen it failed after a few seconds.
I've added a mention on the project page, with an empty "Meaning" parameter. I didn't see the error mentioned above or in the archives. Thanks. Quiddity (WMF) (talk) 22:56, 23 February 2023 (UTC)
Bug 174 - Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)[edit]
- Bug report: https://github.com/toolforge/video2commons/issues/174 .--RZuo (talk) 17:57, 2 December 2023 (UTC)
An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)"
Videos in which it occured:
RodRabelo7 (talk) 00:34, 1 May 2023 (UTC)
- @RodRabelo7: try again now maybe? the code was recently updated.--RZuo (talk) 22:08, 2 June 2023 (UTC)
- @RodRabelo7: I managed to upload those videos for you as File:AO VIVO - Presidente Lula assina atos com o governo chinês.webm and File:Lula fala com a imprensa na saída do hotel na China.webm. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 20:57, 11 December 2023 (UTC)
- Got the same error too, on this video. – Illegitimate Barrister (talk • contribs), 17:19, 18 June 2023 (UTC)
Subtitle error, even when subtitles are unchecked[edit]
Bug report: https://github.com/toolforge/video2commons/issues/174
Getting this error message even though subtitles are unchecked: "An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)" – Illegitimate Barrister (talk • contribs), 11:05, 5 August 2023 (UTC)
YouTube videos that have a livestream chat attached cannot be uploaded[edit]
An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)"
Even when subtitles are turned off in upload settings, the error still happens. – Illegitimate Barrister (talk • contribs), 06:50, 14 October 2023 (UTC)
Discussion[edit]
if you want to download the video onto your devices and then upload, see Commons_talk:Video2commons/Archive_1#v2c_on_Windows_for_Dummies.--RZuo (talk) 17:57, 2 December 2023 (UTC)
- @Yann: i tested using yt-dlp on my laptop. ytdlp can download video+audio tracks, no problem.
- so now i guess the problem is v2c's setup about subtitles. i havent understood which part of the code handles subtitles and how. i'll investigate a few weeks later if the problem persists.
- 1 thing to note is, google search says, "JSONDecodeError: Expecting value: line 1 column 1 (char 0)".--RZuo (talk) 17:57, 2 December 2023 (UTC)
- i might have found a solution https://github.com/toolforge/video2commons/pull/175#issuecomment-1837231635 . i pushed a fix. RZuo (talk) 20:11, 2 December 2023 (UTC)
- @RodRabelo7 @Illegitimate Barrister can you plz try again now? RZuo (talk) 18:22, 11 December 2023 (UTC)
- @RZuo: It got uploaded, but the lowest resolution SD version got uploaded even though it was an HD video. – Illegitimate Barrister (talk • contribs), 23:46, 11 December 2023 (UTC)
- @RodRabelo7 @Illegitimate Barrister can you plz try again now? RZuo (talk) 18:22, 11 December 2023 (UTC)
Telegram group wmcloud[edit]
consider reporting potential problems of the servers to https://t.me/wmcloudirc in future. RZuo (talk) 22:18, 2 June 2023 (UTC)
Error: Stuck on "Loading..."[edit]
Error: Stuck on "Loading..." – Illegitimate Barrister (talk • contribs), 21:02, 5 June 2023 (UTC)
- Care to elaborate? Hard to debug without more information. Chico Venancio (talk) 16:28, 9 June 2023 (UTC)
- Can't upload at all. I go onto Video2Commons.toolforge and all I see is the spinning icon and "Loading..." – Illegitimate Barrister (talk • contribs), 16:31, 9 June 2023 (UTC)
- Does the browser console show any errors? I certainly cannot reproduce that. Chico Venancio (talk) 16:32, 9 June 2023 (UTC)
- Clearing cookies might help as well, since it will force you to re-authenticate with commons. Chico Venancio (talk) 16:37, 9 June 2023 (UTC)
- Message: Content Security Policy: The page’s settings observed the loading of a resource at wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=wU1GQKrEoU9e-SQIAAL0 (“default-src”). A CSP report is being sent. – Illegitimate Barrister (talk • contribs), 16:55, 9 June 2023 (UTC)
- CSP is set to
[Report Only]
, so it should work. Are you behind any network proxies, by any chance? Proxies may not allow websocket connections to work. Chico Venancio (talk) 17:06, 9 June 2023 (UTC)- I don't think I'm using any proxies. I also get the message: Cookie “v2c-session” does not have a proper “SameSite” attribute value. Soon, cookies without the “SameSite” attribute or with an invalid value will be treated as “Lax”. This means that the cookie will no longer be sent in third-party contexts. If your application depends on this cookie being available in such contexts, please add the “SameSite=None“ attribute to it. – Illegitimate Barrister (talk • contribs), 17:08, 9 June 2023 (UTC)
- CSP is set to
- Message: Content Security Policy: The page’s settings observed the loading of a resource at wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=wU1GQKrEoU9e-SQIAAL0 (“default-src”). A CSP report is being sent. – Illegitimate Barrister (talk • contribs), 16:55, 9 June 2023 (UTC)
- Can't upload at all. I go onto Video2Commons.toolforge and all I see is the spinning icon and "Loading..." – Illegitimate Barrister (talk • contribs), 16:31, 9 June 2023 (UTC)
Weird, all of a sudden it started working for me! Hopefully it stays working, I've got a huge backlog to get done now. – Illegitimate Barrister (talk • contribs), 14:03, 18 June 2023 (UTC)
- I've been experiencing this issue for the past three days. File:차세대 미드필더 이승모의 첫 인터뷰!.webm successfully got through, but a different video I tried uploading a few minutes after that never made it. I haven't been able to get through the loading page since. ✗plicit 14:20, 27 June 2023 (UTC)
- Stopped working again, darn. – Illegitimate Barrister (talk • contribs), 03:08, 29 June 2023 (UTC)
- Huh, for some reason, V2C just won't upload [2]. It gets up to "Cleaning up..." and just gets stuck there. I had no problem uploading another video just moments after trying the aforementioned link. ✗plicit 11:25, 30 July 2023 (UTC)
- Stopped for me, too. Logging out and deleting a 0 byte cookie did not help. On a positive note, we now have transcodes for all four of my video uploads in the past three hours. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 22:31, 11 December 2023 (UTC)
- My Chrome Console said the following:
- Stopped working again, darn. – Illegitimate Barrister (talk • contribs), 03:08, 29 June 2023 (UTC)
Navigated to https://video2commons.toolforge.org/
jquery.min.js:4 XHR finished loading: GET "https://video2commons.toolforge.org/api/csrf".
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
/favicon.ico:1
GET https://video2commons.toolforge.org/favicon.ico 500 (Internal Server Error)
index.js:83 [Report Only] Refused to connect to 'wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=vo70RCXQr37VKmoYAAAT' because it violates the following Content Security Policy directive: "default-src 'self' 'unsafe-eval' 'unsafe-inline' blob: data: filesystem: mediastream: *.toolforge.org wikibooks.org *.wikibooks.org wikidata.org *.wikidata.org wikimedia.org *.wikimedia.org wikinews.org *.wikinews.org wikipedia.org *.wikipedia.org wikiquote.org *.wikiquote.org wikisource.org *.wikisource.org wikiversity.org *.wikiversity.org wikivoyage.org *.wikivoyage.org wiktionary.org *.wiktionary.org *.wmcloud.org *.wmflabs.org wikimediafoundation.org mediawiki.org *.mediawiki.org wss://video2commons.toolforge.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback.
r.doOpen @ index.js:83
r.open @ index.js:83
r.probe @ index.js:83
r.onOpen @ index.js:83
r.onHandshake @ index.js:83
r.onPacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
n @ index.js:83
e.decodePayload @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
index.js:83 XHR finished loading: GET "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3G51".
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
jquery.min.js:4 XHR finished loading: GET "https://video2commons.toolforge.org/api/iosession".
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
(anonymous) @ video2commons.min.js:1
r.emit @ index.js:83
r.emit @ index.js:83
r.onconnect @ index.js:83
r.onpacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.ondecoded @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
a.add @ index.js:83
r.ondata @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
n @ index.js:83
e.decodePayload @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
index.js:83 XHR finished loading: GET "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3G84&sid=vo70RCXQr37VKmoYAAAT".
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
index.js:83 XHR finished loading: POST "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3GEb&sid=vo70RCXQr37VKmoYAAAT".
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doWrite @ index.js:83
(anonymous) @ index.js:83
(anonymous) @ index.js:83
o @ index.js:83
(anonymous) @ index.js:83
(anonymous) @ index.js:83
e.encodePacket @ index.js:83
i @ index.js:83
i @ index.js:83
c @ index.js:83
e.encodePayload @ index.js:83
r.write @ index.js:83
r.send @ index.js:83
r.flush @ index.js:83
r.sendPacket @ index.js:83
r.write.r.send @ index.js:83
(anonymous) @ index.js:83
r.encode @ index.js:83
r.packet @ index.js:83
r.packet @ index.js:83
r.emit @ index.js:83
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
(anonymous) @ video2commons.min.js:1
r.emit @ index.js:83
r.emit @ index.js:83
r.onconnect @ index.js:83
r.onpacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.ondecoded @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
a.add @ index.js:83
r.ondata @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
n @ index.js:83
e.decodePayload @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
video2commons.toolforge.org/:1 Uncaught (in promise) Error: A listener indicated an asynchronous response by returning true, but the message channel closed before a response was received
- — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 22:36, 11 December 2023 (UTC)
Task is Pending[edit]
It looks like the tool is broken, as my uploads can't get past "task is pending". Elisfkc (talk) 15:36, 7 June 2023 (UTC)
- Same. Says "Loading..." forever for me. – Illegitimate Barrister (talk • contribs), 20:06, 8 June 2023 (UTC)
- Hard to debug without more information. When it happened? With what file? Was it from a URL or from local upload? Since we have ongoing uploads daily I'd say the tool is not (too) broken. Chico Venancio (talk) 16:31, 9 June 2023 (UTC)
- I get the error message: index.js:83 [Report Only] Refused to connect to 'wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=bUNGulxKYfDkwhLOAAMf' because it violates the following Content Security Policy directive: "default-src 'self' 'unsafe-eval' 'unsafe-inline' blob: data: filesystem: mediastream: *.toolforge.org wikibooks.org *.wikibooks.org wikidata.org *.wikidata.org wikimedia.org *.wikimedia.org wikinews.org *.wikinews.org wikipedia.org *.wikipedia.org wikiquote.org *.wikiquote.org wikisource.org *.wikisource.org wikiversity.org *.wikiversity.org wikivoyage.org *.wikivoyage.org wiktionary.org *.wiktionary.org *.wmcloud.org *.wmflabs.org wikimediafoundation.org mediawiki.org *.mediawiki.org wss://video2commons.toolforge.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback. – Illegitimate Barrister (talk • contribs), 17:21, 9 June 2023 (UTC)
- That issue seems to be fixed, but now I am getting "An exception occurred: AttributeError: b"module 'pywikibot.data.api' has no attribute 'APIError'"". Elisfkc (talk) 16:40, 13 June 2023 (UTC)
- It indicates there was an API error with the upload (from mediawiki). I just fixed an issue so the error message will be more specific, like
pywikibot.exceptions.UploadError: exists-normalized: File exists with different extension as
orpywikibot.exceptions.UploadError: was-deleted
. Chico Venancio (talk) 20:22, 13 June 2023 (UTC)- Ok, I'm now getting "An exception occurred: AttributeError: b"module 'pywikibot' has no attribute 'Error'"". I am trying to upload a video from YouTube at the moment, specifically this one. I am also trying to upload a couple of videos from Facebook, such as this one. Elisfkc (talk) 16:38, 14 June 2023 (UTC)
- A problem with deploying changes resurrected that one. Should be fixed. Chico Venancio (talk) 22:29, 14 June 2023 (UTC)
- @Elisfkc: You had File:President Biden Welcomes the Kansas City Chiefs to the White House.webm deleted? — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 20:29, 11 December 2023 (UTC)
- Ok, I'm now getting "An exception occurred: AttributeError: b"module 'pywikibot' has no attribute 'Error'"". I am trying to upload a video from YouTube at the moment, specifically this one. I am also trying to upload a couple of videos from Facebook, such as this one. Elisfkc (talk) 16:38, 14 June 2023 (UTC)
- It indicates there was an API error with the upload (from mediawiki). I just fixed an issue so the error message will be more specific, like
- That issue seems to be fixed, but now I am getting "An exception occurred: AttributeError: b"module 'pywikibot.data.api' has no attribute 'APIError'"". Elisfkc (talk) 16:40, 13 June 2023 (UTC)
- I get the error message: index.js:83 [Report Only] Refused to connect to 'wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=bUNGulxKYfDkwhLOAAMf' because it violates the following Content Security Policy directive: "default-src 'self' 'unsafe-eval' 'unsafe-inline' blob: data: filesystem: mediastream: *.toolforge.org wikibooks.org *.wikibooks.org wikidata.org *.wikidata.org wikimedia.org *.wikimedia.org wikinews.org *.wikinews.org wikipedia.org *.wikipedia.org wikiquote.org *.wikiquote.org wikisource.org *.wikisource.org wikiversity.org *.wikiversity.org wikivoyage.org *.wikivoyage.org wiktionary.org *.wiktionary.org *.wmcloud.org *.wmflabs.org wikimediafoundation.org mediawiki.org *.mediawiki.org wss://video2commons.toolforge.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback. – Illegitimate Barrister (talk • contribs), 17:21, 9 June 2023 (UTC)
Weird, all of a sudden it started working for me too! Hopefully it stays working, I've got a huge backlog to get done now. – Illegitimate Barrister (talk • contribs), 14:03, 18 June 2023 (UTC)
- I've had the same error for a couple of days, but it worked smooth in June. Weird! TaronjaSatsuma (talk) 18:04, 5 July 2023 (UTC)
- @Elisfkc, Illegitimate Barrister, and TaronjaSatsuma: it's moving now again. RZuo (talk) 14:38, 7 July 2023 (UTC)
I'm having that "Your task is pending..." issue right now, trying to upload a quite short and small (40 MB) video. Uploading the video itself seems to work, then I can add the description, but it's getting stuck at "Your task is pending..." Gestumblindi (talk) 21:42, 20 July 2023 (UTC)
- I see the same. Today and for last several days. Sneeuwschaap (talk) 11:53, 24 July 2023 (UTC)
- To my surprise, video2commons actually finished my pending task now, and uploaded the file (File:Hsb brocken pfingsten 2023.webm) - more than a week later! Gestumblindi (talk) 19:34, 28 July 2023 (UTC)
"Something went terribly wrong"[edit]
Got another error:
Something went terribly wrong, and we failed to find the cause automatically. Please file an issue in GitHub.
Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 89, in save_session self.redis.delete(self.prefix + session.sid) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1567, in delete return self.execute_command('DEL', *names) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.
19:37, 30 June 2023 (UTC) – Illegitimate Barrister (talk • contribs), 19:37, 30 June 2023 (UTC)
Broken[edit]
Hi fellows! A friend is reporting that for at least 2 days the v2c in browser states "Your task is pending...". Could someone check this? Thanks! Ixocactus (talk) 21:02, 24 July 2023 (UTC)
- I and others have noticed this as well, see above. It seems that this important tool is in a poor state and poorly mantained, as it seems to be broken more often than not... Gestumblindi (talk) 18:15, 27 July 2023 (UTC)
- Ops. Thanks Gestumblindi, sorry for duplication. Now the tool is back. But I agree that this need more technical support. Cheers. Ixocactus (talk) 05:28, 28 July 2023 (UTC)
- Was broken for me earlier but back again, hopefully it stays working. – Illegitimate Barrister (talk • contribs), 11:06, 5 August 2023 (UTC)
- For me, it has once against been stuck on "Loading..." for a week now. I wonder why the tool works for some and not for others? Anyway, I'm curious about something to someone who has access to a functioning V2C. Would anyone be able to provide a direct link to the "Add task" function? I wonder if this could work as a loophole to get me past the loading page and somehow allow me to upload videos anyway. ✗plicit 00:18, 6 August 2023 (UTC)
An exception occurred[edit]
DownloadError: b'ERROR: \r[download] Got error: HTTP Error 403: Forbidden. Giving up after 10 retries' Kelly The Angel (talk) 09:15, 16 August 2023 (UTC)
- i dont understand, why File:A walk with the Tigress.webm could be imported from youtube today. mine from youtube gets this error for a few days now. RZuo (talk) 20:23, 18 August 2023 (UTC)
- probably an error from ytdlp, similar to https://github.com/ytdl-org/youtube-dl/issues/3721 . RZuo (talk) 20:26, 18 August 2023 (UTC)
- On uploading: this video with this URL, I got the error:
An exception occurred: DownloadError: b'ERROR: \r[download] Got error: HTTP Error 403: Forbidden. Giving up after 10 retries'
- Noting, this is the same as above. JimKillock (talk) 12:50, 19 August 2023 (UTC)
- YTDL is working for me for the videos failing here, so using that is a possible workaround, if far less convenient. Is there any way to check how up to date the YTDL version is that Video2commons is using? JimKillock (talk) 08:43, 20 August 2023 (UTC)
- it was recently switched to ytdlp, so it's not ytdl anymore.
- i'm having the same problem with https://www.youtube.com/watch?v=-y8G7ID9aM8 . i dont understand why some other videos from youtube could be uploaded in the mean time. RZuo (talk) 07:43, 26 August 2023 (UTC)
- Do we know which version of YTDLP it is using? If we can compare with CMD line results and verify it is the same we can at least report the problem to YTDLP. Or, if YTDLP is working, we can ask for it to be updated here? JimKillock (talk) 12:19, 26 August 2023 (UTC)
- @RZuo: I managed to get File:Barmont Maple in Huntsville prepares for maple syrup production.webm uploaded for you. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 19:58, 11 December 2023 (UTC)
- YTDL is working for me for the videos failing here, so using that is a possible workaround, if far less convenient. Is there any way to check how up to date the YTDL version is that Video2commons is using? JimKillock (talk) 08:43, 20 August 2023 (UTC)
- On uploading: this video with this URL, I got the error:
- probably an error from ytdlp, similar to https://github.com/ytdl-org/youtube-dl/issues/3721 . RZuo (talk) 20:26, 18 August 2023 (UTC)
Same problem, tried 5 different videos. – Illegitimate Barrister (talk • contribs), 09:33, 6 September 2023 (UTC)
Video2commons is broken more often than not, I think, and apparently, there's nobody available for the thorough fixing / revision this tool would need... Gestumblindi (talk) 17:57, 6 September 2023 (UTC)
- For some reason this bug only applies to YouTube. This tool works perfectly with Archive.org, Aparat and Odnoklassniki. Kelly The Angel (talk) 04:47, 8 September 2023 (UTC)
- It shows this error Download failed. creating YoutubeDL instance without local cache. However, youtube-dl currently doesn't seem to work anymore. Yt-dlp at the latest version still works fine and seems to be better anyway by now so maybe it should be swapped for yt-dlp?
- Until that is done, you can download videos with yt-dlp using commands of uploads in this new cat: Category:Videos downloaded with yt-dlp with command included. Prototyperspective (talk) 16:57, 9 September 2023 (UTC)
- afaicu, v2c has been using ytdlp since april 2023 https://github.com/toolforge/video2commons/pull/162 . RZuo (talk) 19:43, 9 September 2023 (UTC)
- Thank you - if we know what version of YTDLP is used by v2c then we can check if it is a bug at YTDLP, tho, and ask someone to simply upgrade YTDLP here. YTDLP is in a constant cat and mouse game with YT shifting its formats, one would expect. Is anyone able to find this out? JimKillock (talk) 10:33, 10 September 2023 (UTC)
- Just a note: if yt-dlp is used, then why did the error "..creating YoutubeDL instance.."? Prototyperspective (talk) 10:45, 10 September 2023 (UTC)
- I expect that is just the message given by v2c and it hasn't been updated? As YTDL and YTDLP are forks of the same project they probably got swapped out behind the scenes with not too much work, and whatever messages v2c gives us at the frontend were perhaps not changed? Your code snippet linked seems to bear this out, the code references "ytdlp" (
dl = yt_dlp.YoutubeDL(params)
). JimKillock (talk) 10:49, 10 September 2023 (UTC)
- I expect that is just the message given by v2c and it hasn't been updated? As YTDL and YTDLP are forks of the same project they probably got swapped out behind the scenes with not too much work, and whatever messages v2c gives us at the frontend were perhaps not changed? Your code snippet linked seems to bear this out, the code references "ytdlp" (
- Just a note: if yt-dlp is used, then why did the error "..creating YoutubeDL instance.."? Prototyperspective (talk) 10:45, 10 September 2023 (UTC)
- Thank you - if we know what version of YTDLP is used by v2c then we can check if it is a bug at YTDLP, tho, and ask someone to simply upgrade YTDLP here. YTDLP is in a constant cat and mouse game with YT shifting its formats, one would expect. Is anyone able to find this out? JimKillock (talk) 10:33, 10 September 2023 (UTC)
- afaicu, v2c has been using ytdlp since april 2023 https://github.com/toolforge/video2commons/pull/162 . RZuo (talk) 19:43, 9 September 2023 (UTC)
I'm still getting the same error, though it seems there have been other successful uploads recently [3]. John P. Sadowski (NIOSH) (talk) 03:54, 22 September 2023 (UTC)
- No recent successful uploads. This tool seems to be completely broken☹️ Kelly The Angel (talk) 13:20, 9 October 2023 (UTC)
- I managed to upload some videos, however despite being HD they were uploaded in 144p (again, despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:12, 9 October 2023 (UTC)
- File:Inside a McDonald's restaurant in 1984.webm, for example? Transcode status on the page says "Error on 23:07, 9 October 2023"; maybe rather a Commons than a Video2commons issue in this case... Gestumblindi (talk) 09:50, 10 October 2023 (UTC)
- @Illegitimate Barrister: I managed to add resetting the transcodes for two formats on that file to the job queue. I also managed to upload File:Inside a McDonald's restaurant in 1984 (larger).webm to replace it (this tool won't let me overwrite). — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 19:50, 11 December 2023 (UTC)
- File:Inside a McDonald's restaurant in 1984.webm, for example? Transcode status on the page says "Error on 23:07, 9 October 2023"; maybe rather a Commons than a Video2commons issue in this case... Gestumblindi (talk) 09:50, 10 October 2023 (UTC)
Error: Unable to download webpage[edit]
I wanted to upload a freely-licensed video (https://newsmediab.tasnimnews.com/Tasnim/Uploaded/Video/1402/03/02/1402030214310229727644641.mp4), but I got the following error:
Error: An exception occurred: DownloadError: b"ERROR: [generic] None: Unable to download webpage: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1123)> (caused by URLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1123)')))"
Is there anything I can do? HeminKurdistan (talk) 15:04, 28 September 2023 (UTC)
Stalled[edit]
Hi, I imported 3 small videos yesterday (around 20s each), and I still get "Your task is pending". Any idea? Yann (talk) 12:45, 4 October 2023 (UTC)
- I managed to upload some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:12, 9 October 2023 (UTC)
Stuck[edit]
Hello! I've been trying to upload some rather large videos for the past 2 days. They're 1.5gb ~20 min long. Well, it's just 1 video but I've tried uploading in all 3 different formats, trying to make it work. Nothing works. The tasks have been pending since forever and no progress is made no matter how much I wait. What could be going on? Should I maybe just wait even more? (I've tried waiting for longer than 24 hours.) Any help would be appreciated. - Klein Muçi (talk) 11:23, 5 October 2023 (UTC)
- I managed to upload some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:12, 9 October 2023 (UTC)
Bug 173 - Youtube videos uploaded in bad resolution (often 144p)[edit]
Bug Report: https://github.com/toolforge/video2commons/issues/173
I uploaded some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talk • contribs), 23:13, 9 October 2023 (UTC)
- Same issues from me. --A1Cafel (talk) 09:25, 15 October 2023 (UTC)
- Same problem with File:Gone with the Wind and the Lies America Tells- Sarah Churchwell in conversation.webm Kelly The Angel (talk) 13:54, 27 October 2023 (UTC)
- Hi, I got this issue too with 2 videos: File:Popeye the Sailor - Aladdin and His Wonderful Lamp (1939) (Remastered HD).webm and File:POPEYE THE SAILOR MAN- Aladdin and His Wonderful Lamp (1939) (Remastered) (HD 1080p) - Margie Hines.webm. Yann (talk) 15:45, 25 November 2023 (UTC)
- Another example today. – Illegitimate Barrister (talk • contribs), 10:43, 30 November 2023 (UTC)
- This is a recurrent issue, so I created Category:Videos with bug 173. Yann (talk) 12:30, 30 November 2023 (UTC)
- i found the problem and wrote on github.
- basically, youtube now has various Youtube Format IDs. our old default "vp9" now only refers to 144p.
- someone needs to code up the solution. i dont have time for now.--RZuo (talk) 14:58, 30 November 2023 (UTC)
- Some videos can be uploaded, and the smaller the more chances they get through. Surprisingly, some long HR videos got uploaded, i.e. File:Beat the Devil (H. Bogart - G. Lollobrigida, 1953) HD.webm: 1 h 29 min 20 s, 1,280 × 720 pixels, 1.34 Mbps overall, file size: 855.16 MB. Yann (talk) 21:56, 1 December 2023 (UTC)
- @Yann: Could that be because it came from dailymotion.com? — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 03:57, 2 December 2023 (UTC)
- @Jeff G.: I also got one from YT: File:The Chase (1946) by Arthur Ripley.webm. Yann (talk) 10:51, 2 December 2023 (UTC)
- Looks completely random AFAICT. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 11:14, 2 December 2023 (UTC)
- @Yann err... the file has an intro by a modern guy, but no youtube cc licence or pd declaration. i think you need to cut it. RZuo (talk) 14:02, 2 December 2023 (UTC)
- and for why it could be downloaded in high resolution. it doesnt have a vcodec of "vp9", so v2c chose the best video track possible (ID 137), i guess.
- @Jeff G.: I also got one from YT: File:The Chase (1946) by Arthur Ripley.webm. Yann (talk) 10:51, 2 December 2023 (UTC)
- @Yann: Could that be because it came from dailymotion.com? — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 03:57, 2 December 2023 (UTC)
- Some videos can be uploaded, and the smaller the more chances they get through. Surprisingly, some long HR videos got uploaded, i.e. File:Beat the Devil (H. Bogart - G. Lollobrigida, 1953) HD.webm: 1 h 29 min 20 s, 1,280 × 720 pixels, 1.34 Mbps overall, file size: 855.16 MB. Yann (talk) 21:56, 1 December 2023 (UTC)
Extended content |
---|
|
RZuo (talk) 15:11, 2 December 2023 (UTC)
- for these videos yall linked above, when you go to youtube and pick the quality (resolution), you will see an option "1080p premium". i guess we can assume all such videos will have this problem. videos without this dont have this problem (for now).
- the problem is https://gist.github.com/MartinEesmaa/2f4b261cb90a47e9c41ba115a011a4aa#high-video-quality-of-video-only . nobody knows if they will roll this out to all videos.
- i already gave a fix that will stop selecting video tracks based on vcodec (numbers like vp09.00.51.08), waiting for it to be committed on github. RZuo (talk) 14:13, 2 December 2023 (UTC)
Scope of damage[edit]
1. Affects other videos (not only 144p)
for https://www.youtube.com/watch?v=ZZOovh7cKSI , yt-dlp shows the best track with vcodec "vp9" is only 1280x720, but other tracks can go up to 2160p.
i uploaded File:Nobu Okada Interview 2019.webm on 7 July 2023. it's down from 1080p to 360p. maybe problem like this has been around for a while, but we might not have noticed if it's not so bad as 144p.--RZuo (talk) 06:50, 3 December 2023 (UTC)
- https://commons.wikimedia.org/w/index.php?sort=create_timestamp_desc&search=filetype%3Avideo+fileheight%3A%3C222+youtube+incategory%3A%22Uploaded+with+video2commons%22
- potentially affected videos (fileheight<222). RZuo (talk) 10:14, 3 December 2023 (UTC)
- Right. The oldest I could find with this bug is File:Helicopter Footage Shows High-Speed Chase of Florida Man Wanted in Doctor's Stabbing.webm, uploaded on October 10th.--Yann (talk) 12:00, 3 December 2023 (UTC)
- sadly, no. 😂
- File:Rosie the Therapy Dog.webm
- File:Pet therapy teams make a difference to Lakeview Hospice patients.webm
- File:Nobu Okada Interview 2019.webm 7 July 2023
- (╯°□°)╯︵ ┻━┻ --RZuo (talk) 12:13, 3 December 2023 (UTC)
- OK, I added 2 in the category, but I don't see any higher resolution for File:Pet therapy teams make a difference to Lakeview Hospice patients.webm. Yann (talk) 12:24, 3 December 2023 (UTC)
- youtube has 480p. here 360p. RZuo (talk) 12:33, 3 December 2023 (UTC)
- Ah yes, right. I reuploaded this video, and it is now OK. Yann (talk) 13:12, 3 December 2023 (UTC)
- Idem for File:Rosie the Therapy Dog.webm. Yann (talk) 13:27, 3 December 2023 (UTC)
- thx a lot! you doing this merging page trick is much easier than if i do download and overwrite. RZuo (talk) 13:40, 3 December 2023 (UTC)
- File:Nobu Okada Interview 2019.webm OK now. V2C works fine here, so the issue for these videos was a different one. Yann (talk) 14:15, 3 December 2023 (UTC)
- it's the same problem. i wrote on github.
- basically, the problem is, if the track that has vcodec=vp9 is inferior, v2c still picks it, because it's designed to prioritise in this order: codec > extension > resolution.
- i think this certainly is not correct. we should prioritise resolution (quality), then codec and extension. RZuo (talk) 14:53, 3 December 2023 (UTC)
- and v2c uploads them in highest resolution now, because all the tracks dont have vcodec=vp9 anymore, so it defaults to picking the best track as set by yt-dlp's parameter "bestvideo". RZuo (talk) 15:24, 3 December 2023 (UTC)
- @Yann How did you do that? The merging trick, i mean. MilkyBoba (talk) 06:44, 11 December 2023 (UTC)
- File:Nobu Okada Interview 2019.webm OK now. V2C works fine here, so the issue for these videos was a different one. Yann (talk) 14:15, 3 December 2023 (UTC)
- thx a lot! you doing this merging page trick is much easier than if i do download and overwrite. RZuo (talk) 13:40, 3 December 2023 (UTC)
- youtube has 480p. here 360p. RZuo (talk) 12:33, 3 December 2023 (UTC)
- OK, I added 2 in the category, but I don't see any higher resolution for File:Pet therapy teams make a difference to Lakeview Hospice patients.webm. Yann (talk) 12:24, 3 December 2023 (UTC)
- Right. The oldest I could find with this bug is File:Helicopter Footage Shows High-Speed Chase of Florida Man Wanted in Doctor's Stabbing.webm, uploaded on October 10th.--Yann (talk) 12:00, 3 December 2023 (UTC)
2. Problem intensified probably around Aug 2023
this problem might have become more common due to YouTube rolling out "‘enhanced’ 1080p for Premium subscribers" to desktop in aug 2023.[1]--RZuo (talk) 12:13, 3 December 2023 (UTC)
References
Summary[edit]
Cause
A Youtube video typically has various video and audio tracks. For each track, there is a string called "VCODEC" or "VBR ACODEC".
The current way v2c selects which tracks to upload is:
'bestvideo[vcodec={{vcodec}}][filesize<{max}]+' 'bestaudio[acodec={{acodec}}]/' 'bestvideo[ext={{vext}}][filesize<{max}]+' 'bestaudio[ext={{aext}}]/' 'bestvideo+bestaudio/best'
Assuming you choose the default "webm (VP9/Opus)". This means, the code will first select the best track with vcodec=vp9; only if no track has vcodec=vp9, will it select the best tract with ext=webm; and so on. Sometimes, tracks with vcoded=vp9 are not the best resolution, then v2c ends up uploading these worse tracks. (Sometimes, no track has vcodec=vp9, then v2c selects tracks based on the next criteria and uploads good tracks.)
Affected videos
This bug has affected youtube videos uploaded since Jul 2023 (earliest we have found so far). Many videos were uploaded in 144p, but the bug has also let videos be uploaded in less optimal resolutions but not 144p. See #Scope of damage for more details.
What you should do
I have pushed fixes on github, waiting for commit. If you can code, please help out on github. I am a novice in coding.
You can wait and not use v2c for now. We will notify you once this bug is fixed.
You can also use yt-dlp to check a video ( yt-dlp -F URL
). If no track, or the best track, has vcodec=vp9, you can safely use v2c.
For affected videos, append Category:Videos with bug 173 if not already done so. You can also fix it by yourself:
- download from youtube to your device
- overwrite the problematic file with the local file on your device (you might need User:Rillke/bigChunkedUpload.js).
--RZuo (talk) 08:08, 3 December 2023 (UTC)
- @RZuoThanks a lot for the investigation and PR. I have merged and deployed it, on my tests it does seem to fix the issue. Chico Venancio (talk) 18:27, 11 December 2023 (UTC)
- @Chicocvenancio thank you so much Chico for always getting v2c back to work! RZuo (talk) 18:32, 11 December 2023 (UTC)
Stuck in loading[edit]
It's been a few days that Video2commons gets stuck indefinitely in loading after I log in. Any such experience? HeminKurdistan (talk) 18:09, 26 October 2023 (UTC)
Audio cut off[edit]
I just uploaded this file using Video2commons:
File:ARRL 2023 CW Sweepstakes action movie.agr.webm
The video is fine but the audio cuts off after a few seconds. Is there any thing I needed to do differently? The audio is the whole point of the file.--agr (talk) 17:17, 23 November 2023 (UTC)
- @ArnoldReinhold: there is sound throughout the video for me. can you check again? maybe it was because you just uploaded the video and commons servers were still transcoding it.--RZuo (talk) 17:57, 2 December 2023 (UTC)
MaybeEncodingError[edit]
Bug report: https://github.com/toolforge/video2commons/issues/176
Hi, I got this error while uploading [4]. This is a big file, but if the error is due to the size (it doesn't seem so from the message), there should be a warning before, instead of processing the file for 3 days and then failing. Yann (talk) 11:19, 5 December 2023 (UTC)
An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/debadae0b49d62d0/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/debadae0b49d62d0/dl.mp4.vp9.webm.log /srv/v2c/output/debadae0b49d62d0/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'
- @Yann: I don't think it's the size. Got this "MaybeEncodingError" today (see below) for a rather small (32 MB, 15 seconds) video from my device. Gestumblindi (talk) 17:48, 10 December 2023 (UTC)
Unable to download JSON metadata[edit]
Bug report: https://github.com/toolforge/video2commons/issues/177
Hi, I got an error while downloading https://www.dailymotion.com/video/x5qb7u9 Yann (talk) 20:14, 8 December 2023 (UTC)
An exception occurred: DownloadError: b'ERROR: [dailymotion] x5qb7u9: Unable to download JSON metadata: HTTP Error 401: Unauthorized (caused by <HTTPError 401: Unauthorized>); please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U'
- It happens again with https://www.dailymotion.com/video/x7s00m2 Yann (talk) 14:49, 11 December 2023 (UTC)
- This one is probably because the video is too big. Yann (talk) 15:25, 11 December 2023 (UTC)
- Seems the fallback to server side upload in case of mediawiki api errors had a bug since the port to python 3. It should be fixed. Chico Venancio (talk) 18:08, 11 December 2023 (UTC)
- This one is probably because the video is too big. Yann (talk) 15:25, 11 December 2023 (UTC)
argument must be str, not bytes[edit]
Bug report: https://github.com/toolforge/video2commons/issues/178
Hi, I got this message while uploading God's Little Acre (1958) from YT. Yann (talk) 10:38, 9 December 2023 (UTC)
An exception occurred: TypeError: b'write() argument must be str, not bytes'
Hopeless case?[edit]
It seems that this tool is broken in so many ways and it's only a matter of a lot of luck if you manage to successfully upload a video. My most recent try today (uploading a moderately sized video of 15 seconds duration from my device) resulted in this cryptic error message:
An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/555119d3bac84652/dl.unknown_video -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/555119d3bac84652/dl.unknown_video.vp9.webm.log /srv/v2c/output/555119d3bac84652/dl.unknown_video.vp9.webm\\\\\\\\nExitcode: 137\\\')>, None)"\')'
Then I clicked on "Restart" and got "An exception occurred: OSError: b'[Errno 12] Cannot allocate memory'". It's sad that apparently no one is really maintaining that tool as it would be a great help with uploading videos to Commons (which is otherwise even more cumbersome). Gestumblindi (talk) 17:46, 10 December 2023 (UTC)
Server crashed[edit]
Hi, Now I get The connection to the server has failed. Please refresh this page or file an issue in GitHub.
Yann (talk) 21:42, 11 December 2023 (UTC)
WorkerLostError[edit]
Hi, I also got An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 15 (SIGTERM) Job: 188.'
and again An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 15 (SIGTERM) Job: 18.'
with https://player.pbs.org/viralplayer/3036869056/ Yann (talk) 22:04, 11 December 2023 (UTC)