Beyond Reality Face Documentation.
API for Beyond Reality Face.
rev. 1.7
If you want to use Flare3D for your 3D content.
Flare 3D is not part of Beyond Reality Face.
We prefer to use this Flash 3D engine to render all 3D content.
(you will be redirected to their page).
Do you need help or
hints to get started?
Please use:
1. Facebook
>discuss here
2. A contact-form
>mail us
3. Twitter.
FAQ
1. What is the difference to other Augmented Reality SDKs?
While other SDKs use certain features of predefined pictures for detection, Beyond Reality Face can use an arbitrary face. It is able to find a face in either a webcam stream or a picture and calculate the head pose in realtime. There is no need to save any markers or pictures in advance or even print out a given marker. This detection works for all kind of faces and is optimised to run on the web.
2. What can i do with it ?
You can detect and track faces in photos or webcam streams. Also you can calculate a head pose from a given picture. This allows you to place 2D or 3D objects onto a users head or enable users to control apps with head movements.
Use it as a tool for interaction or as controller for an app. Whereever a face can be found it can be used for the mentioned purpose. No matter whether you look in the camera by yourself or hold up a photo of somebody.
3. Who can use the SDK and what licenses do you offer?
We don't have restrictions so everybody can play around. You have to stick to the limitations of the SDK licenses, though. If you're planning on developing apps for third parties you need to contact us for permission first. If you intend on a commercial use there are licenses available for that as well. And finally if you are unsure whether the trial license applies to you please contact us.
4. What is the trial version and who can use it?
The trial license can be used for personal purposes and non-commercial projects. This counts for developers who are not being compensated for their work with our API in any way. The trial license can be rejected and revoked by Tastenkunst at any time.
5. What is the difference between trial and commercial-license?
Both versions provide the same functionality. The trial version includes a branding, consisting of our logo and a trial license note in the menu. Please be aware of that if you use it. The logo has to be visible at all times and a link to our site has to be available. You are not allowed to cover the logo or remove the link to BRF.
6. How do i start?
Our downloadable SDK comes with a Flash SWC library and examples.
7. Which workspace and skills are needed?
Using the SDK requires a good knowledge of Actionscript 3. Ideally you would need some IDE with the latest Flex installed. We deliver the examples as a FDT (Powerflasher Flash Development Tools) project.
8. Which 3D Engines are supported?
For now Flare3D, Away3DLite and Away3D are supported.
We recommend Flare3D, for the neatless workflow.
9. Will it work with Molehill?
Yes, we already have a working Molehill version. It will be released once the 3D Engines are fully ready for the new API.
10. Can I track multiple faces at the same time?
No. If there are multiple people in the image, BRF locks onto one person only. You can seamlessly switch the tracked face if multiple people occur in the same picture by switching the faces that are in focus of the camera, though.
11. Will it work on anyone?
The quality of our tracking depends on multiple factors. In our extensive tests we have achieved solid results with multiple faces and images. And even though we can't guarantee perfect results for every face and every condition, you can still rely on a capable tracking in the vast majority of conditions.
12. What if I’m wearing sunglasses or thick spectacles?
It still works.
13. Does it work in dark or bright conditions?
Yes. The main issue is the frame-rate of the camera. Webcams often lower frame-rates in dark conditions.
Tracking with less than 10fps works, but not nearly as well as with better illumination.
If the image is very dark or almost saturated white, then obviously there is not much the camera can “see” to track, however, if the face is partially covered the tracking is still fairly good.
14. Can you track other things besides faces?
No.
15. Does the user need a webcam?
No, the user does not need any webcam. Faces can be detected on single images, too.
16. Does the user need a printed marker or predifined image?
Neither of this is required. Every image will work, as long as a face of reasonable size can be found.
Beyond Reality Face is a product of
Our technology partner
UG (haftungsbeschränkt)
Grassistrasse 12
04107 Leipzig
Germany
IN2AR - Natural feature tracker
an Adobe Flash AS3 Library to
detect images and estimate their pose.
www.in2ar.com