Python Error: UnicodeEncodeError - Can't launch game as of 4/14

[marewey]

I have made no changes to anything, and was playing last night, however today when I launched, javaw.exe just hung after launching, checking logs I found this: I have tested with a new minecraft install, but this appears to be a python error.

[ .. ] Loading version forge-1.19.2-43.3.5...
[ OK ] Loaded version forge-1.19.2-43.3.5

[ .. ] Loading version 1.19.2...
[ OK ] Loaded version 1.19.2

[ .. ] Loading java...
[ OK ] Loaded Mojang java 17.0.8

[ OK ] Checked version jar

[ .. ] Checking assets version 1.19...
[ OK ] Checked 3390 assets version 1.19

[ .. ] Checking libraries...
[ OK ] Checked 91 class and 0 native libraries

[ OK ] Using logger client-1.12Exception in thread Minecraft Stream Thread:
Traceback (most recent call last):
File "c:\users\redacted\appdata\local\programs\python\python38\lib\threading.py", line 932, in _bootstrap_inner
self.run()
File "c:\users\redacted\appdata\local\programs\python\python38\lib\threading.py", line 870, in run
self._target(*self._args, **self.kwargs)
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\standard.py", line 1634, in process_stream_thread
if not parser.feed(line, self.process_stream_event):
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\standard.py", line 1677, in feed
callback(self.next_event)
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\cli_init.py", line 887, in process_stream_event
out.print(f"[{time}] [{event.thread}] [{event.level}] {event.message}\n")
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\cli\output.py", line 181, in print
print(text, end="")
File "c:\users\redacted\appdata\local\programs\python\python38\lib\encodings\cp1252.py", line 19, in encode
return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode characters in position 292-299: character maps to

When researching the bottom line, somebody said to fix it, you need to make sure you define your encoding table, like utf-8

[Ristovski]

I think this is Minecraft itself crashing but the returned log could have some weird encoding making python think its cp1252:

Exception in thread Minecraft Stream Thread:

Could you go into your .minecraft/logs folder and see if the latest.log file correlates (by checking date etc) with the crash? If so, its contents should tell you more about the crash.

[mindstorm38]

I wonder why this error happens on the "print" call tbh, is it possible to change the encoding of stdout? I've never seen this problem...

[Ristovski]

I believe this might be due to a mismatch in the data returned on stdout and the inferred system encoding of Popen (i.e. import locale; locale.getpreferredencoding()). Though I am not sure.

[mindstorm38]

Interesting, on Windows I get "cp1252", on Linux I get "UTF-8". This might be our issue, also it looks like that it's possible to do sys.stdout.reconfigure(encoding="utf-8") since Python 3.7, but I wonder if Windows shell will be happy about that. In fact, I had an issue with a Rust tool I was working on where Windows refused to print invalid UTF-8 codes, so maybe we'll need a way to ignore, or format as hex maybe, any game's log that is not valid UTF-8.

Source: https://docs.python.org/3/library/io.html#io.TextIOWrapper.reconfigure

[marewey]

Interesting, I haven't changed anything on my end at all, and it worked yesterday, so i figured it must have been something to do with a cached file having strange characters (as in it downloads this file at every launch, for instance a version index or something like that). I did check my minecraft log, it did launch it for a second, this is all it had:

[20:27:17] [main/INFO]: ModLauncher running: args [--username, Redacted, --version, forge-1.19.2-43.3.5, --gameDir, C:\redacted, --assetsDir, C:\redacted\assets, --assetIndex, 1.19, --uuid, redacted, --accessToken, redacted, --clientId, , --xuid, , --userType, , --versionType, release, --launchTarget, forgeclient, --fml.forgeVersion, 43.3.5, --fml.mcVersion, 1.19.2, --fml.forgeGroup, net.minecraftforge, --fml.mcpVersion, 20220805.130853]
[20:27:17] [main/INFO]: ModLauncher 10.0.8+10.0.8+main.0ef7e830 starting: java version 17.0.8 by Microsoft; OS Windows 10 arch amd64 version 10.0

I have even attempted to remove all mods, it does not change the error.

Also just to note: I am on PMC Version: 4.2.1 and Python Version: 3.8.10

[marewey]

Another thing to give you guys...
This is what happens when i switch output to machine from human:

Exception in thread Minecraft Stream Thread:
Traceback (most recent call last):
File "c:\users\redacted\appdata\local\programs\python\python38\lib\threading.py", line 932, in _bootstrap_inner
self.run()
File "c:\users\redacted\appdata\local\programs\python\python38\lib\threading.py", line 870, in run
self._target(*self._args, **self.kwargs)
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\standard.py", line 1634, in process_stream_thread
if not parser.feed(line, self.process_stream_event):
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\standard.py", line 1677, in feed
callback(self.next_event)
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\cli_init.py", line 887, in process_stream_event
out.print(f"[{time}] [{event.thread}] [{event.level}] {event.message}\n")
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\cli\output.py", line 279, in print
self.print_function("print", text)
File "c:\users\redacted\appdata\local\programs\python\python38\lib\site-packages\portablemc\cli\output.py", line 264, in print_function
print(name, ":", ",".join((self.print_escape(arg) for arg in [
File "c:\users\redacted\appdata\local\programs\python\python38\lib\encodings\cp1252.py", line 19, in encode
return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode characters in position 305-312: character maps to
task:..,start.version.loading,version=forge-1.19.2-43.3.5
task:OK,start.version.loaded,version=forge-1.19.2-43.3.5
task:..,start.version.loading,version=1.19.2
task:OK,start.version.loaded,version=1.19.2
task:..,start.jvm.loading
task:OK,start.jvm.loaded.mojang,version=17.0.8
task:OK,start.jar.found
task:..,start.assets.resolving,index_version=1.19
task:OK,start.assets.resolved,index_version=1.19,count=3390
task:..,start.libraries.resolving
task:OK,start.libraries.resolved,class_libs_count=91,native_libs_count=0
task:OK,start.logger.found,version=client-1.12
print:\n
print:

Hope this helps

Also in my previous experiences with PMC it never did log the console out before, however I do have PMC auto updating after every reboot.

[marewey]

I have figured out what breaks it... it is when you try and output to a file. Adding >>test.log causes the error, but works without outputting to log. The strange part is that it has been working, but only recently broke today.

[marewey]

When I do launch it from a console like normal, i did notice if you do not state an accesstoken it shows up as --accessToken, ❄❄❄❄❄❄❄❄ .... it looks like ?????? with boxes, but i guess it is snowflakes. lol.

[mindstorm38]

Yes these snowflakes are shown by forge to avoid displaying the token in clear.

[mindstorm38]

I have figured out what breaks it... it is when you try and output to a file. Adding >>test.log causes the error, but works without outputting to log. The strange part is that it has been working, but only recently broke today.

Thank you for this clear feedback! I can reproduce it!

[mindstorm38]

Looks like sys.stdout.reconfigure fixes the problem.