Android Question Very fast reading a binary file

thedesolatesoul

Expert

Licensed User

Longtime User

• Oct 8, 2014

• #2

It will be faster to read all (or some) of the bytes using ReadBytes and then later converting them to unsigned and doing operations on it.

 

Upvote 0

Informatix

Expert

Licensed User

Longtime User

• Oct 8, 2014

• #3

To read and write bytes, forget the RandomAccessFile library. It is very very slow. Read or write your byte array with a simple InputStream/OutputStream.

 

Upvote 0

AlpVir

Well-Known Member

Licensed User

Longtime User

• Oct 8, 2014

• #4

Reading with InputStreamToBytes lasts 0.8 sec.
The For-Next loop to rework the result lasts for 43 seconds.
There is some internal function that make the calculations more quickly?
I also feel InputStream but now I feel I have the impression that the sticking point is precisely the elaboration of the results, not the reading.

B4X:

Dim b() As Byte = Bit.InputStreamToBytes(File.OpenInput(File.DirRootExternal  , "DEM/3/N44E007.hgt"))
For i=0 To b.Length -1 Step 2
    Buffer(N)=b(i)*256+b(i+1)
    N=N+1  
Next

 

Upvote 0

AlpVir

Well-Known Member

Licensed User

Longtime User

• Oct 8, 2014

• #5

Slightly faster: reading file 0.192 sec; data processing 43.53 seconds
You can do better ?
Tanks !

B4X:

Dim InputStream1 As InputStream
    InputStream1 = File.OpenInput (File.DirRootExternal, "DEM/3/N44E007.hgt")
    L=File.Size (File.DirRootExternal, "DEM/3/N44E007.hgt")
    Dim b(L) As Byte
    count = InputStream1.ReadBytes (b, 0, b.length-1)
    For i=0 To b.Length -1 Step 2
       Buffer(N)=b(i)*256+b(i+1)
       N=N+1  
    Next

 

Upvote 0

RandomCoder

Well-Known Member

Licensed User

Longtime User

• Oct 8, 2014

• #6

Would using a bit shift instruction be quicker than mathematically multiplying by 256 I wonder?
B4A Help docs, bit

Regards,
RandomCoder

 

Upvote 0

thedesolatesoul

Expert

Licensed User

Longtime User

• Oct 8, 2014

• #7

No idea. Try

B4X:

Buffer(N) = Bit.Or(Bit.ShiftLeft(b(i),8), b(i+1))

i remember B4A internally cnoverts most things to double so i wonder if this is casting overhead.

 

Upvote 0

Daestrum

Expert

Licensed User

Longtime User

• Oct 8, 2014

• #8

You could use nio to read the byte buffer as Int(s), but it would read 4 bytes per Int, maybe read it as Short(s) if you just want 2 byte values.

 

Upvote 0

Erel

B4X founder

Staff member

Licensed User

Longtime User

• Oct 9, 2014

• #9

There is no double conversion in this case.

Are you testing the speed in Release mode? What is the file size?

 

Upvote 0

AlpVir

Well-Known Member

Licensed User

Longtime User

• Oct 9, 2014

• #10

The file is 2818 KB
I've always used the debug mode for this short piece of code.
Moving on to a real device in release mode I got the following times
Solution Buffer (N) = b (i) * 256 + b (i + 1) 0.7 sec
Solution Buffer (N) = Bit.OR (Bit.ShiftLeft (b (i), 8), b (i + 1)) 0.9 sec

These are times that I think are acceptable, at least in this stage of development of the app that reads and interprets the DEM files
Thanks to all of the aid

 

Upvote 0

thedesolatesoul

Expert

Licensed User

Longtime User

• Oct 9, 2014

• #11

I do however finding interesting that a Shift+OR is slower than multiply+add.
I guess modern 32/64-bit processors work in registers of atleast 32-bits so they dont even care if the data is only 8-bits, or they are optimized more for a MAC operation.

 

Upvote 0

RandomCoder

Well-Known Member

Licensed User

Longtime User

• Oct 9, 2014

• #12

I also find it surprising that bit shifting is slower than using arithmatic. Very interesting!

 

Upvote 0

MaFu

Well-Known Member

Licensed User

Longtime User

• Oct 9, 2014

• #13

A real bit shift would be faster. But B4A hasn't it and the function call proceeds the overhead.

 

Upvote 0