Russian text received from PC ICQ users garbled

I try to chat with my friends using iChat but i can't. They can read my messages but i can't read their...

For example, I receive "ïðèâåò!" but it must be "привет!" (hope you can see a difference 🙂 )


PowerBook 15" Mac OS X (10.4.6) 1.67Ghz, 2Gb RAM

-------------------------------





When text such as Russian text displays all messed up like this (ÃÂº) or this (ˆÐµÐ» о) it is because the process chain between your interface and the source material is ignoring or dynamically converting the character encoding of the original material.


Obviously if you can see the Russian text anywhere correctly (Русская клавиатура) your system is capable of displaying Russian and that makes the problem even more interesting to investigate.


It means a geometry of encoding swap farce is using your system to gum up certain language and encoding zones so-to-speak.


First you need to figure out if the character encoding you are using is the actual character encoding of the source material. You can do this by using javascript or any type of terminal extension to detect the encoding.


There is however no guarantee that your layer of observation and the layer upon which the detected encoding presents it’s self to your detection software are the same virtual layer of farce.


You may try to detect the encoding of the script using your own software.. For this example we will assume your software extension is called detect_encoding(). detect_encoding(‘Русская клавиатура’); should return the actual encoding of the string.


On my system the string ‘Русская клавиатура’ shows up as UTF-8 which means it is a deep-encoded farce string displayed in my interface with false encoding. Obviously only certain encodings (not utf-8 normally) can display the Cyrillic character set.


Next we need to find out what other front-face-farce encodings can display the Russian text properly through the current back-end farce filters that you are struggling to eliminate.


Take the same text and convert this text into a long list of encodings then save the list of encoded Russian characters to a file and list them out through the same detect_encoding function. If any of the encodings are different then you may have found the farce-swap attack!


There is no guarantee that the deep-seeded farce has not installed it’s self as a proxy inside your detection and conversion equipment however. When this is the case you may need to resort to cross-platform troubleshooting and letter-charts.


Keep trying and if all else fails, use an alphabet chart function to manually convert the characters or to confirm the conversions. If the attacker is using dynamic intermediary characters in combination with encoding swap geometry rendered in 3d to maintain a farce bubble you can easily identify this and write an antivirus program so your text will appear as it is saved.

Posted on Jan 22, 2018 7:39 AM

Reply
15 replies

Feb 7, 2018 1:25 PM in response to J Bigga

J Bigga wrote:


the Russian text was entered in on the same system that it was displayed later garbled.


Really? I thought you said the text looked fine to the sender but was garbled at the recipient (your) end, so different computer systems connected via the iChat app.


I suspect at their end they could using a legacy encoding windows cyrillic font. No modern computer OS would include one of those, so the codes they send you are interpreted as Unicode Latin 1 characters. If you were able to read their text with the same font they are using, it would look correct. Or if you put the text in to a text editor, save as Latin 1, and then reopen as cp1251.


Encodings do get changed all the time without any nefarious purpose. In TextEdit you can produce copies of any text in dozens of different encodings if you need to in order to facilitate communication with older systems.

Feb 8, 2018 5:10 AM in response to J Bigga

I don't see any "encryption" in the example you provided. The underlying byte data in hex format seems to be EF F0 E8 E2 E5 F2. In win 1252 (latin 1) those bytes represent ïðèâåò. In win 1251 (russian) they represent привет. In win 1253 (greek) they represent οπθβες.


It is easy for a user/viewer to wind up using the wrong encoding for data, it happens frequently on web pages where the author of the page accidentally omits a line of html code, or if an app mistakenly uses an old legacy encoded font.

Feb 8, 2018 1:19 PM in response to J Bigga

Hi,


You have this version of iChat according to what you have posted

http://www.ralphjohns.co.uk/versions/ichat3/ichat3pics/Prefs/slides/iChat3Messag esPrefs.html

The picture on that page is of the Preferences > Messages pane.


You can choose the Outgoing Font (style) the Font Colour (default is black) and the Balloon colour in iChat 3


You can also override the same choices regarding the incoming messages.


In this picture the Incoming messages are not overridden.

User uploaded file


As it is a group chat iChat will pick different colours for the Balloons where it can.

Ron's Large type face and blue balloons are his choice but David's blue balloon's are iChat's choice hence the two blue people.

You can also see that some of the other Fonts are different. In some cases I can only see the messages in those Fonts as I have those Fonts.

Some will have defaulted to Helvetica


There is this page Garbled Font in iChat & Mail | Design Department.

The link to the Trouble Shooting page which used to show picture is no longer available.

Tom may have a fresher link as he sent me the original.

It was in this Thread Messages font issue


Tom's own User Tip on the subject

Fixing Garbled Text

As mentioned the first Link does not work and the Homepage option died along with .Mac services.


It is similar to Video tape players.

In the Untied States they used NTSC

In most of Europe they used PAL.

With Satellite services and Digital ground based services instead of Analogue your newer Digital TV may not be compatible with the signal coming out of the box.


Or as Tim puts it:-


I don't see any "encryption" in the example you provided. The underlying byte data in hex format seems to be EF F0 E8 E2 E5 F2. In win 1252 (latin 1) those bytes represent ïðèâåò. In win 1251 (russian) they represent привет. In win 1253 (greek) they represent οπθβες.


You have to be using a Font that can do the Russian bit.


To mix in the analogy, if they are sending you PAL (Font) then you have to use a PAL capable Font.

If you are using an NTSC font then your TV/iChat will not display it as the correct PAL Font




User uploaded file

9:19 pm Thursday; February 8, 2018


 iMac 2.5Ghz i5 2011 (Sierra)
 G4/1GhzDual MDD (Leopard 10.5.8)
 MacBookPro 2Gb (Snow Leopard 10.6.8)
 Mac OS X (10.6.8),
 iPhone 6 iOS 11.x and an iPad (2)

Feb 7, 2018 12:46 PM in response to J Bigga

J Bigga wrote:


only certain encodings (not utf-8 normally) can display the Cyrillic character set.



These days UTF-8 is in fact the standard encoding for Cyrillic and all other non Latin scripts. When legacy 8-bit non-Unicode Cyrillic encodings like CP1251, ISO-8859-5, KOI8 are used, problems like you describe often arise.


Your example ïðèâåò looks like WIndows CP1251 encoded Cyrillic being read as if it were ISO Latin-1. Perhaps there is no encoding indicator on the incoming stream to tell iChat to use the right one, or perhaps iChat is just buggy in this area.

Jan 22, 2018 1:02 PM in response to J Bigga

Hi,


In simpler terms I would have said that it was whether the iChat end was using a Font that allows the Cyrillic Characters to be displayed.


iChat works on the basis that if you have the Font that is being sent to you then it will display.

If not it will stick to what is chosen as your outgoing Font.


OS X 10.4.6 is not even the top or last version of OS X 10.4 that was OS X 10.4.11


iChat 3.x.x can only do AIM and Bonjour.

ICQ was owned by AIM at one point but was sold off to some Russians.


You could add ICQ Buddies and AIM Buddies at one stage but I had though the Russians had moved away from also using port 5190 to login.

That said I would guess you have found some ICQ server info that allows this to work.


AT iChat 3 Jabber was Added (I have not got Jabber in my current set up in OS X 10.4.11) but Google have a Jabber server and you have to alter the Server Settings in a Jabber account to make Google work at this version.


At iChat 4 a Google variant was added to allow for the different server naming process Google use.


iChat 6 saw a Yahoo option added. This lasted only until Messages 10 when Yahoo dropped the app they were using and rewrote the whole App that Apple have not joined again.


At version 7 th App changed names to Messages as the iMessages account was shoehorned into the App.

Since then various iChat features have gone, including Video/Audio Only chat within the App and Screen Sharing within the app.


In December AIM finally ended the AIM service.

As such Messages 11 in macOS 10.13.x (There have been two version 8s) cannot do AIM or Bonjour or Yahoo



This means that for a version as old as yours Jabber is the only version that works unless you have computers using nothing higher that macOS 10.12.x where you could still use Bonjour.

This would be the last version that would have an Active AIM Plug-in that might allow ICQ to work.







User uploaded file

9:02 pm Monday; January 22, 2018


 iMac 2.5Ghz i5 2011 (Sierra)
 G4/1GhzDual MDD (Leopard 10.5.8)
 MacBookPro 2Gb (Snow Leopard 10.6.8)
 Mac OS X (10.6.8),
 iPhone 6 iOS 11.x and an iPad (2)

Jan 22, 2018 2:11 PM in response to Tom Gewecke

Hi,


In iChat 3.x.x the balloon info is actually inside the app.

It is later moved out to a Plug-in for the Message Style.


However some apps will open the files and show that they are HTML items with code for the balloon colour the Font and it's colour.


I am not sure there was any info about substitution of Fonts.

I do know you could set out going and incoming Fonts so that it might be more readable to you.

This might mean that a Font override for incoming Messages might not be compatible with what the info is in the "Balloon" coming from the other end.


On top of that AIM on a PC used less colour in the display of the text tending to only colour the sender's name.

I an not sure about ICQ but I would suspect the info for the display of the messages is even more limited.


I am not sure that iChat was ever that clever in finding a suitable Font when this happens.


User uploaded file

10:11 pm Monday; January 22, 2018


 iMac 2.5Ghz i5 2011 (Sierra)
 G4/1GhzDual MDD (Leopard 10.5.8)
 MacBookPro 2Gb (Snow Leopard 10.6.8)
 Mac OS X (10.6.8),
 iPhone 6 iOS 11.x and an iPad (2)

Feb 7, 2018 12:46 PM in response to Tom Gewecke

Well, Ralph anyone can see that this issue is a result of too many encoding swaps forming a part of the global encryption geometry. Why would text that was written in one encoding ever be displayed in another encoding?


This issue has more to do with offensive perpetrators infesting the connectivity geometry than a swap or mis-match of formats.


After all, if the user entered in the text what could the issue be with it's encoding unless the user was imitated by a robot or script?


Why would text encoding ever dynamically change?


Please explain your answer and let me know why downloading new Cyrillic fonts would be a part of any smart person's troubleshooting process?


Thanks,

J

Feb 7, 2018 12:44 PM in response to Tom Gewecke

Thank you Tom, very astute!


Your evaluation of the current situation is probably right on.


The issue is the change in encoding swap geometry here since the Russian text was entered in on the same system that it was displayed later garbled.


Clearly we would have stopped typing if the russian text was garbled as it was written.


Now the same saved data is going through a different global encryption and encoding geometry and the original writing is displayed incorrectly.


Tom, how would you suggest we target a group of sabotage perpetrators who see fit to play games with web standards such as text encoding and encryption?


Could we find a way to block any changes to the way OSX opens prior saved text?


Let me know!


I look forward to your reply Tom,

John Browning

Feb 7, 2018 1:32 PM in response to Tom Gewecke

Well Tom I don't think anyone would understand why you'd focus on who entered in and who was reading the text.


It's not the point! Why was the text encoding ever messed with to begin with and why would text entered in Russian show up as something else ever.


We saved the text on a platform that showed Russian letters as we typed and then later the text showed up garbled on the same platform.


It's because of abusive text-encoding swap systems that have started to emerge in networks and it is a plague of destruction of property. I'm surprised you'd take the stance of focusing on the user as if the user was anything but the victim of hack or virus.


Please tell me why any properly set up system would dynamically swap the encoding of text so that the text would need an interpreter later. Encryption is used to obscure text and once text is typed and encoded any one can read the same encoding as long as they know what the encoding is.


If what you mentioned were even relevant, the garbled text could simply be reverse-encoded back to Russian. This is not the case. The text is garbled on a letter-for-letter level in a way that indicates character-encoding swaps were used as part of an encryption geometry that was exposed to Mac OSX.


Please explain why smart people in computing should ever try to blame the client for an attack so offensive that it garbles the very text the client enters.


Thanks,
J

Feb 7, 2018 2:31 PM in response to Ralph-Johns-UK

Ralph, again please refrain from changing the subject because some people actually are victim of character encoding zone-swaps.


Obviously you don't know what would cause these swaps if you are posting pictures of your iChat.


The fact remains that the cross-web content exchange or internet process is to blame here because a transfer layer of encryption and/or encoding-swap-layers is interfering with the content but not the chat participants.


What kind of formats other then plaintext contain information about their own text encoding? Are the text ellements of the page getting re-packaged by a proxy?


What would change the Russian-Russian link to make it Russian-Garbled.


Many native fonts included in common web browser can display Russian and so nobody would say this has to do with fonts. Why did you mention fonts above?


Ralph, please explain how your answer even relates to the topic?


J

Feb 7, 2018 1:56 PM in response to J Bigga

Hi,


iChat will display the Font that is sent to you only if you have that Font.


If you do not have the Font that is being sent to you then the app should default to using Helvetica.

In OS X 10.4 Helvetica is included as a System Font and this determines it's location on the Hard drive.


However there are many other versions of Helvetica (or at least show that name in various menus) that may have been installed. Office install many with the same name (or so it seems) when the actual Font Type is the issue.


They have different suffixes such as .ttf .otf .ttc and .dfont

There are older Postscript versions as well and those also come in variants of there own depending on the printers that will work with.

There are older .bmp and .suit as well if you have been "gathering" Fonts over the years.


Whether the Helvetica version you have is the one that was in System Fonts I cannot say. Tom is the one that knows much more than I do about which version it should be.


Running two Font apps can be an issue as to which Fonts are On or Disabled.


Your reply is linked to Tom's last post but addressed to me.

My interpretation of what Tom is saying is - try something else.


That's even before we get to the UTF coding numbers.


It is possible that the Russian end is what has changed.

AIM sold ICQ to some Russian firm some while back.

If they have been updating the app then most likely it is going to have a means of transposing incoming Fonts to what the app uses.

What it probably does not do is do the same for outgoing messages (iChat does not either).

If the Fonts used in the app are "new" then you may not have them or have a Font that can transpose them for iChat.


It could be that the AIM sell off including keeping a gateway on the AIM servers to smooth the process and with the demise of AIM that is no longer possible.

However that would mean you logging in to AIM whilst your Russian friends logged into ICQ

You would know as it would have been possible to use the AIM set up in Chat to log in to different Servers

You can see the Server Setting option tab in this pic:-

User uploaded file


I suspect it is a change at the ICQ app end.







User uploaded file

9:56 pm Wednesday; February 7, 2018


 iMac 2.5Ghz i5 2011 (Sierra)
 G4/1GhzDual MDD (Leopard 10.5.8)
 MacBookPro 2Gb (Snow Leopard 10.6.8)
 Mac OS X (10.6.8),
 iPhone 6 iOS 11.x and an iPad (2)

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Russian text received from PC ICQ users garbled

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.