Comments on: Augmented Reality with NyARToolkit, OpenCV & OpenGL

By: Roy

Roy — Sat, 31 Dec 2011 07:28:03 +0000

@KeenBeginner
I gave your problem some thought, and it seems like you can easily achieve this with ARToolkit! Take a look at the API:
http://artoolkit.sourceforge.net/apidoc/ar_8h.html

All you need to do is populate an ARMarkerInfo struct
Fill it up with info of the face, like the corners can be the corners you get from CascadeClassifier::detectMultiScale, or your more accurate info from the facial features

Then use arGetTransMat (and the like) to get the proper transformtion matrix for OpenGL… then display some graphics as you like.

This will be a very initial solution! but it will definitely get you results right away, because everything exists and ready for you.

I can also highly recommend Jason Saragih’s 3D face detection libary:
http://web.mac.com/jsaragih/FaceTracker/FaceTracker.html

By: KeenBeginner

KeenBeginner — Thu, 29 Dec 2011 13:21:48 +0000

Hi Roy

This is great work.
I am a beginner and currently working on a project. I am to track a human face and then display 3d objects (hat/mask/beak on the mouth) on the tracked faces and fix those 3d objects on the face even when the face is rotated and moved. I have managed to detect faces and extract coordinates of certain keypoints of the face. I am using OpenCV for that. And as you suggested above, I am going to transfer the grabbed frame and display it in OpenGL.
From my understanding, you acquire your projection matrix on the marker using the augmented reality toolkit. I am not using that and only have fixed coordinates of the keypoints as mentioned before so I am quite confused on how to proceed. I’d really appreciate if you could provide me some direction as to how I may be able to solve my problem.

Many thanks

By: Roy

Roy — Wed, 30 Nov 2011 22:53:07 +0000

@sample
These days I would actually fall back on ARToolkit.. or use some library. NyARToolkit seems kind of dead..

By: sampie

sampie — Sat, 26 Nov 2011 12:56:54 +0000

hi Roy!
it’s great tutorail!! thanks for sharing!:)
i was asking if NyARtoolkit has a doc for C++ because i didn’t find any thing on the net!

By: Arnau

Arnau — Wed, 16 Nov 2011 17:54:24 +0000

Hi!! I’m a student and I’m working with NyArtoolkit. I have two doubts with my project. I have to use diferents markers and models thats came in Nyartoolkit by default. Do you know any web to download some markers or any way to create my own markers ??? The same think with the 3D models. Thank for your time!!!!!!

By: Ashley

Ashley — Fri, 28 Oct 2011 06:36:41 +0000

hello,

This project is to be created on VS C++ , console project? is any library of OpenCV Required? Require help.
Or anyone have the codes to share for me to refer?

Contact me @ manchesterlim@hotmail.com

By: Michael

Michael — Fri, 27 Aug 2010 20:39:05 +0000

As the cpp port of the nyartoolkit is not available in english, i am a little confused as to how i need to setup visual studio 2008 for using the toolkit. I have already downloaded, what i believe, to be the necessary files for the toolkit at “http://sourceforge.jp/projects/nyartoolkit/downloads/47617/NyARToolkitCPP-2.5.4.zip/” ; however, i see that this is entirely sourcecode for different platforms. I was thinking all i needed to do was link to the dll’s like i have done with opengl and sdl. But i am at a lost as to how i would compile this source code into a dll, if that is what i am supposed to do. If i could possibly get a point in the direction of how i should setup the nyartoolkit, i should be merrily on my way with making some interesting programns? Any help is much appreciated(help in setting up nyartoolkit-cpp in visual studio 2008 that is).

~thank you for your time

By: vodre

vodre — Mon, 26 Jul 2010 17:14:30 +0000

hey!
im compiling with the gcc compiler, and i want to know if i could use codeblocks to link the libraries…

can i use more than 1 marker?

sorry for my english, im mexican!

By: Pablo

Pablo — Thu, 20 May 2010 18:10:59 +0000

Hi! I’m getting several errors on VS 2008, even with the suggested modifications.

The one that’s stopping me now is:

1>e:\nyartoolkit\forwindows\nyartoolkitcpp-rawtest\main.cpp(86) : error C2248: ‘NyARToolkitCPP::NyARRgbRaster_BGRA::NyARRgbRaster_BGRA’ : cannot access private member declared in class ‘NyARToolkitCPP::NyARRgbRaster_BGRA’…

Any ideas?

By: Gplanned

Gplanned — Mon, 05 Apr 2010 17:06:40 +0000

Hi there, I am making an app using a iPhone 3G, just wondered if I needed a 3gs or if it would still work on 3g?
Thanks for your time