B4J Question [SOLVED] Reading ANSI text files with greek inside (get ??????)

[Magma]

Hi there,

i have to read some text files but file.readlist returns ????? where are greek letters..

Is there any ansi2utf sub routine ?

example in file:

Auerswald LAN TAPI 20 - Διεύθυνση 0

When output to combolist get that:


Thanks in advance.

 

[DonManfred]

Can you upload such a file (not posting the content)?
Probably it is not encoded in UTF8

 

[Magma]

Ofcourse, i can upload... here it is... (as i said is in ansi format)

 

[Magma]

must be like this

not like this:

 

[DonManfred]

as i said is in ansi format

Notepad++ does not recognize it to be ANSI

This file is UTF8 and it should be loaded into B4A without problem.

 

[DonManfred]

must be like this

DO NOT use Notepad! It is the BADDEST Editor you can use.
Use Notepad++ and make sure to always use UTF8 encoding.

 

[Magma]

My friend DonManfred look the files uploaded ... i uploaded at 984bytes - you uploaded at 1.2KB ...

The file is making by vb6-program using tapi and reading all tapi and writing to text... ANSI... i need to convert it automatically with code in utf-8.. not with notepad++
(i know the tool)

this picture is from combo in b4j

 

[DonManfred]

making by vb6-program

change the vb6 program to generate UTF8 files
Or check the exact encoding. It is NOT ANSI. I´ve loaded your file with notpad++ and it does not recognize it do be ANSI.
Must be any other encoding. Which one?

 

[Magma]

@DonManfred hope there is a technique to encode at utf8 needed by b4j.

Do you have for example Microsoft Excel - try to open using Windows (ANSI) or... 1253: Greek (Windows) or.... 1252: Western Europe (Windows)...

As i remeber the vb6 standard output ansi-1252... so is a must to convert ansi 2 utf...

I´ve loaded your file with notpad++ and it does not recognize it do be ANSI.

As i can remember notepad++ automatically convert to readable format.

 

[Daestrum]

I don't think you can read it as a list, you need to read it with File.OpenInput and inputstream into a buffer.
It is then simple to use BytesToString and specify encoding as cp1252, to get the correct characters.
You can then split it on crlf into an array, which you can put in a list.
eg:

...
Dim inp As InputStream
Dim s_in As String
inp = File.OpenInput("","c:/temp/tapis.txt")
Dim b As Int
Dim my_buf(inp.BytesAvailable) As Byte
b = inp.ReadBytes(my_buf,0,inp.BytesAvailable)
inp.Close
s_in = BytesToString(my_buf,0,b,"cp1252") ' might be cp1253
Dim lines() As String
lines = Regex.Split(CRLF,s_in) ' you can add lines to a list if required after this line
For Each line As String In lines
Log(line)
Next
...

** cp1252 may need to be cp1253 - not sure which matches your output

 

[Erel]

As DonManfred wrote, programmers should use a more decent text editor.

You can use TextReader to read non-UTF8 files:

Dim tr As TextReader
tr.Initialize2(File.OpenInput(File.DirAssets, "tapis.txt"),  "ISO-8859-7")
Dim lines As List = tr.ReadList
tr.Close
Log(lines)

 

[Magma]

@Erel as i said the file producted by vb6 program and may be changing every time runs...

 

[Magma]

@Daestrum really works... needed a .trim.. when added to list

 

[Erel]

@Erel as i said the file producted by vb6 program and may be changing every time runs...

It doesn't matter. The code I posted will always work assuming that the encoding is correct.

 

[Magma]

Erel yes - your code works perfect too... and much smaller.

Thank you all - guys.. keep moving

 

[klaus]

As your files are generated by Windows you could also use "Windows-1253" as the caracter set.

 

[Magma]

@klaus 1253 + ISO-8859-7 works (vb6 generates ansi cp-1253 for exactly but iso-8859-7 works perfect for me too)