Android Tutorial Camera2 - Still images and videos

Erel · Sep 14, 2017

Camera2 library is based on the Camera2 API introduced in Android 5 (API 21).
It is designed to work together with CamEx2 class.
It is supported by B4A v7.3+. The library will be included as an internal library in the next update.

Both image capturing and video recording are supported.
CamEx2 class is built to be extended. Camera2 native API is huge.

The configuration steps:

1. Open the camera when the activity is resumed.
2. Prepare the surface and start preview. The preview size and capture size are set at this point.
3. Stop the camera when the activity is paused.

Take pictures with FocusAndTakePicture or TakePictureNow.

Video capturing is done by calling StartVideoRecording and StopVideoRecording.
The surface needs to be recreated after the video is recorded.

TaskIndex

When you open the camera you receive a number called TaskIndex:

B4X:

Wait For (cam.OpenCamera(front)) Complete (TaskIndex As Int)
If TaskIndex > 0 Then
   MyTaskIndex = TaskIndex 'hold this index. It will be required in later calls.
   Wait For(PrepareSurface) Complete (Success As Boolean)
End If

If the value of TaskIndex is 0 then the camera failed to open. Otherwise you need to store it in a global variable and pass it to other camera methods.

The camera can be stopped or reopened while other asynchronous tasks are running. The task index is used to cancel running tasks in such cases.

Notes & tips

- The RECORD_AUDIO is not added automatically as it is only required when recording video. In such case you need to add it with the manifest editor:

B4X:

AddPermission(android.permission.RECORD_AUDIO)

CamEx2 class is is included in the attached example.
It depends on Camera2 v1.10+.

Change log

- V1.31 - Changes the behavior of PreviewCropRegion to affect the captured image as well (previously it was inconsistent).
- V1.30 - Fixes an issue with video orientation.
- V1.20

Example updated and targetSdkVersion is set to 26. Permissions are handled at runtime.
Digital zoom feature. Note that it only affects the preview.
Fixed typo in getSupportedVideoSizes method.

New example:

Based on B4XPages (there are instructions inside if you want to use it in an Activity module).
Preview image is not stretched.
Captured image is shown with the correct orientation.

rboeck · Sep 25, 2017

Axon7:
I made an unfiltred log; you see the crash at line 858. I could make four photos, switched to video and after ending of record it crashed.
Sometimes it starts with this message: "Failed to open camera"
Sony Tablets SPG321 and SPG521:
The problem with unknown const 18 i could also find on my sony xperia tablets; it was logged in line 364 of CamEx2 class, release of today. Currently i need one minute of playing to get the message. When starting the app on sony tablet i get always:
--------- beginning of system
--------- beginning of crash
--------- beginning of main
on the older sony tablet the line with crash is the first.
Nexus 5:
Everything works without problems

I hope, this report can bring some 'light' to the CamEx problems...

Erel · Sep 25, 2017

What happens after this error is printed?

Change the two subs to:

B4X:

Private Sub IntToConst (Int1 As Object, Consts As List) As String
   If Int1 = Null Then Return ""
   Dim i As Int = Int1
   If i >= 0 And i < Consts.Size Then
     Return Consts.Get(i)
   Else
     Log(Consts)
     Log("Unknown const: " & i)
     Return ""
   End If
End Sub

Private Sub IntsToConstsList (Ints As Object, Consts As List) As List
   Dim res As List
   res.Initialize
   If Ints = Null Then Return res
   Dim f() As Int = Ints
   For Each mode As Int In f
     If mode >=0 And mode < Consts.Size Then
       res.Add(Consts.Get(mode))
     Else
       Log(Consts)
       Log("Unknown consts: " & mode)
     End If
   Next
   Return res
End Sub

This way we can find which parameter is unknown.

Change ApplicationError in the starter service to:

B4X:

Sub Application_Error (Error As Exception, StackTrace As String) As Boolean
   Log("Application_Error")
   Log(Error)
   Log(StackTrace)
   Return False
End Sub

What happens now?

rboeck · Sep 25, 2017

On Sony i get this result:

** Activity (main) Pause, UserClosed = true **
Ignoring event: camera_surfaceready
Ignoring event: camera_previewcapturecomplete

on Sony SGP521 i could get this results when i click FACE_PRIORITY Button:
*** Service (starter) Create ***
** Service (starter) Start **
** Activity (main) Create, isFirst = true **
** Activity (main) Resume **
Start success: true
Start success: true
Focus not supported
Picture taken: (Bitmap): 1920 x 1080, scale = 1,00
(ArrayList) [DISABLED, FACE_PRIORITY, ACTION, PORTRAIT, LANDSCAPE, NIGHT, PORTRAIT, THEATRE, BEACH, SNOW, SUNSET, STEADYPHOTO, FIREWORKS, SPORTS, PARTY, CANDLELIGHT, BARCODE]
Unknown consts: 18
(ArrayList) [DISABLED, FACE_PRIORITY, ACTION, PORTRAIT, LANDSCAPE, NIGHT, PORTRAIT, THEATRE, BEACH, SNOW, SUNSET, STEADYPHOTO, FIREWORKS, SPORTS, PARTY, CANDLELIGHT, BARCODE]
Unknown consts: 18
(ArrayList) [DISABLED, FACE_PRIORITY, ACTION, PORTRAIT, LANDSCAPE, NIGHT, PORTRAIT, THEATRE, BEACH, SNOW, SUNSET, STEADYPHOTO, FIREWORKS, SPORTS, PARTY, CANDLELIGHT, BARCODE]
Unknown consts: 18
(ArrayList) [DISABLED, FACE_PRIORITY, ACTION, PORTRAIT, LANDSCAPE, NIGHT, PORTRAIT, THEATRE, BEACH, SNOW, SUNSET, STEADYPHOTO, FIREWORKS, SPORTS, PARTY, CANDLELIGHT, BARCODE]
Unknown consts: 18
(ArrayList) [DISABLED, FACE_PRIORITY, ACTION, PORTRAIT, LANDSCAPE, NIGHT, PORTRAIT, THEATRE, BEACH, SNOW, SUNSET, STEADYPHOTO, FIREWORKS, SPORTS, PARTY, CANDLELIGHT, BARCODE]
Unknown consts: 18

The buttons caption doesn't change to disable.

On Axon 7:

Logger verbunden mit: bc412fa1
--------- beginning of system
--------- beginning of main
*** Service (starter) Create ***
** Service (starter) Start **
** Activity (main) Create, isFirst = true **
** Activity (main) Resume **
Start success: true
Start success: true
Start success: true
java.lang.NullPointerException: Attempt to invoke virtual method 'android.view.Surface android.hardware.camera2.params.OutputConfiguration.getSurface()' on a null object reference
at android.hardware.camera2.impl.CameraDeviceImpl$CameraDeviceCallbacks.onCaptureErrorLocked(CameraDeviceImpl.java:1925)
at android.hardware.camera2.impl.CameraDeviceImpl$CameraDeviceCallbacks.onDeviceError(CameraDeviceImpl.java:1693)
at android.hardware.camera2.legacy.CameraDeviceUserShim$CameraCallbackThread$CallbackHandler.handleMessage(CameraDeviceUserShim.java:299)
at android.os.Handler.dispatchMessage(Handler.java:102)
at android.os.Looper.loop(Looper.java:179)
at android.os.HandlerThread.run(HandlerThread.java:61)
Logger verbunden mit: bc412fa1
--------- beginning of system
--------- beginning of main
(ArrayList) [DISABLED, FACE_PRIORITY, ACTION, PORTRAIT, LANDSCAPE, NIGHT, PORTRAIT, THEATRE, BEACH, SNOW, SUNSET, STEADYPHOTO, FIREWORKS, SPORTS, PARTY, CANDLELIGHT, BARCODE]
Unknown consts: 18

The buttons caption change to all possibilities. Only one crash in 3 minutes.

On Sony Z1 Compact the video and the foto preview is 180° turned; this mobile is nearly out of order...

Erel · Sep 25, 2017

The missing constant is fixed in v1.14 (uploaded to the first post). I don't think that it is related to the crash.

Have you tested the ApplicationError code I've posted in post #22?

jimmyF · Sep 25, 2017

Crashed when I tried to switch back from video to still camera.
Focus does not work, nor Scene.

Log file attached:

rboeck · Sep 25, 2017

With this version i get only one crash on my old Sony z1 compact. The crashes with axon 7 are away.
Here i still have the problem with "selfie" cam - i get fotos and videos bottom up, the camera on the back is working regular. The routine starter Application_Error was not executed, but i have no idea, why.

Erel · Sep 26, 2017

Devices with legacy support are more problematic and should probably use Camera instead of Camera2.

I'm unable to reproduce the NullPointerException here, so it is hard for me to fix it.

One thing that worth trying is to add Sleep(500) after each call to CloseSession (put the cursor on CloseSession and click F7 to find where it is called).

rboeck · Sep 26, 2017

What does exactly legacy support mean - how can i know, if a customer is using a legacy device?

PhiloSophical · Sep 26, 2017

..and to add to post #28 - is there a way to establish this before purchasing a device by understanding some hardware/driver characteristic that is known

post #8 may help - this examples my device as being recognised as "Legacy" - Is there a way of getting this output via a b4a library?

Erel · Sep 27, 2017

Add this sub to CamEx2:

B4X:

Public Sub getSupportedHardwareLevel As String
   Dim jo As JavaObject = Camera.GetCameraCharacteristics(0)
   Return IntToConst(jo.RunMethod("get", Array(StaticCameraCharacteristics.GetField("INFO_SUPPORTED_HARDWARE_LEVEL"))), SUPPORTED_HARDWARE_LEVEL)
End Sub

You can call it before you open the camera.

It will return one of the following values: LIMITED, FULL, LEGACY, LEVEL_3

The values are described here: https://developer.android.com/refer...cteristics.html#INFO_SUPPORTED_HARDWARE_LEVEL

PhiloSophical said:
is there a way to establish this before purchasing a device by understanding some hardware/driver characteristic that is known

I don't think so.

rboeck · Sep 27, 2017

Sorry, there is still some information missing: i copied your code to the camex2 example and get (backtranslated unknown member: getcameracharacteristics;
i have tried to add the old camera library, but i didnt help.

Erel · Sep 27, 2017

CamEx2 v1.15 with this code is now available in the first post.

rboeck · Sep 27, 2017

Sorry for making problems: can it be, that a new axon 7, Android 7.1, 4k video capturing is in category legacy? (based on CamEx2 v1.15)

Erel · Sep 27, 2017

If it prints LEGACY when the program is started then it has legacy support.

jimmyF · Sep 27, 2017

Logger connected to: BlackBerry BBB100-1
--------- beginning of main
*** Service (starter) Create ***
** Service (starter) Start **
** Activity (main) Create, isFirst = true **
LEGACY
** Activity (main) Resume **
Start success: true
Start success: true
Start success: true
java.lang.NullPointerException: Attempt to invoke virtual method 'android.view.Surface android.hardware.camera2.params.OutputConfiguration.getSurface()' on a null object reference
at android.hardware.camera2.impl.CameraDeviceImpl$CameraDeviceCallbacks.onCaptureErrorLocked(CameraDeviceImpl.java:1925)
at android.hardware.camera2.impl.CameraDeviceImpl$CameraDeviceCallbacks.onDeviceError(CameraDeviceImpl.java:1693)
at android.hardware.camera2.legacy.CameraDeviceUserShim$CameraCallbackThread$CallbackHandler.handleMessage(CameraDeviceUserShim.java:299)
at android.os.Handler.dispatchMessage(Handler.java:102)
at android.os.Looper.loop(Looper.java:154)
at android.os.HandlerThread.run(HandlerThread.java:61)

So it has legacy support.
Crash occurs when switching back from Video to Still Camera.
Focus button does not get passed OFF then stops responding.
Scene has no effect.
Effect DOES work.
Camera works.
Stopping Video crashes. Message above.

rboeck · Sep 27, 2017

A good explanation about Legacy support: https://stackoverflow.com/questions...ra2-api-to-support-old-and-new-api-versions-w

KingEdem · Oct 2, 2017

Erel said:
Camera2 library is based on the Camera2 API introduced in Android 5 (API 21).
It is designed to work together with CamEx2 class.
It is supported by B4A v7.3+. The library will be included as an internal library in the next update.

Both image capturing and video recording are supported.
CamEx2 class is built to be extended. Camera2 native API is huge.

The configuration steps:

1. Open the camera when the activity is resumed.
2. Prepare the surface and start preview. The preview size and capture size are set at this point.
3. Stop the camera when the activity is paused.

Take pictures with FocusAndTakePicture or TakePictureNow.

Video capturing is done by calling StartVideoRecording and StopVideoRecording.
The surface needs to be recreated after the video is recorded.

TaskIndex

When you open the camera you receive a number called TaskIndex:

B4X:

Wait For (cam.OpenCamera(front)) Complete (TaskIndex As Int) If TaskIndex > 0 Then MyTaskIndex = TaskIndex 'hold this index. It will be required in later calls. Wait For(PrepareSurface) Complete (Success As Boolean) End If

If the value of TaskIndex is 0 then the camera failed to open. Otherwise you need to store it in a global variable and pass it to other camera methods.

The camera can be stopped or reopened while other asynchronous tasks are running. The task index is used to cancel running tasks in such cases.

Notes & tips

- The RECORD_AUDIO is not added automatically as it is only required when recording video. In such case you need to add it with the manifest editor:

B4X:

AddPermission(android.permission.RECORD_AUDIO)

CamEx2 class is is included in the attached example.
It depends on Camera2 v1.10+.

HI Erel,

I would like to superimpose (transparent 30%) date n time on the recording video and snap picture. Please suggest.

Erel · Oct 2, 2017

Please start a new thread in the questions forum.

Croïd · Nov 3, 2017

CamEx2 v1.15

Hi

a) For the shift of the light with the function "ON_ALWAYS_FLASH", The picture remains dark ! Is there a solution ?

b) Can I use the "Torch" function?

Erel · Nov 5, 2017

Please start a new thread in the questions forum.

Android Tutorial Camera2 - Still images and videos

Attachments

Well-Known Member

Attachments

B4X founder

Well-Known Member

B4X founder

Active Member

Attachments

Well-Known Member

B4X founder

Well-Known Member

Member

B4X founder

Well-Known Member

B4X founder

Well-Known Member

B4X founder

Active Member

Well-Known Member

Member

B4X founder

Active Member

B4X founder

Similar Threads

Privacy & Transparency

Privacy & Transparency