ProCamToolkit is a collection software and code for openFrameworks aimed at making high level projector-camera calibration more accessible. It provides examples manual projector calibration using a model of a scene, projector-camera calibration using a reference pattern and gray code scanning, and multi-projector calibration using gray code scanning. A program called "mapamok" has emerged from ProCamToolkit as the most user-friendly app of the collection, and it's useful for experimenting with extremely fast projection mapping in situations where the scene can be modeled quickly (e.g., a collection of cuboids) or where the scene is modeled in advance (e.g., a 3D print, or a manufactured object like a car). Most of ProCamToolkit is written in an extremely modular way, making it possible to borrow snippets of code, including some chunks that are written with the goal of being contributed to the openFrameworks core.
ProCamToolkit also includes work in progress towards new installations being developed during Guest Research Projector v.1 at YCAM Interlab. This includes experiments with augmented shadows using multiple projectors, and projection mapping in the YCAM library.
ProCamToolkit is available under the MIT License.
This is a complex app that will allow you to load a COLLADA file called model.dae
, and then specify some number of points between the model and the corresponding location in the projection. After enough points have been selected, it will solve for the projector location and set the OpenGL viewport to render with the same intrinsics as the projector. For more details about mapamok, see the wiki.
This app is the first step in capturing the data to calibrate a projector-camera system. It will project and capture gray code patterns. If you are scanning a scene, you only need to do this once. If you are calibrating before scanning a scene, you will need to take one scan per detected pattern.
ProCamSampleEdsdk works with a Canon DSLR, while ProCamSampleLibdc works with a Firewire camera. After compiling the app you want to use, run the app, hit f
to fullscreen on the projector, then the space bar to start capturing. Before you start capturing, make sure the camera is not clipping on the brights or darks. In order to capture calibration data from two projectors, change totalProjectors
from 1
to 2
.
This app will calibrate a camera from a sequence of images stored on disk, and save the calibration information into a .yml
file. To use the application, load a sequence of images into the data/images/
directory. Then edit the data/settings.yml
file to reflect the calibration pattern.
In the settings.xml
file, xCount
and yCount
refer to the number of circles or corners in the calibration pattern. squareSize
describes the spacing between the circles or corners. Because calibration is unitless,squareSize
can be in whatever units you want the calibration data to be reported as (normally, millimeters). patternSize
is 0
, 1
, or 2
, which means CHESSBOARD
, CIRCLES_GRID
and ASYMMETRIC_CIRCLES_GRID
.
ShadowCast is work in progress on an installation that explores augmented shadows using multiple projectors. To work properly, it requires two projectors that have been calibrated to a single camera. This calibration information is captured with ProCamSampleEdsdk or ProCamSampleLibdc, then processed by ProjectorGeometryCalibrate, and finally loaded from .exr
displacement maps in the SharedData/
folder. To explore the scenes inside ShadowCast
without calibrating a pair of projectors, run the Scenes
project.
Decodes scan data and projection maps onto the point cloud.
This is app is the first step in capturing the data to gamma calibrate a camera.
Once you've captured the data from the above app, you can feed it into this one to recover the gamma curve of the camera.
Demonstrates how screen-space model selection is implemented for the ModelProjector app.
Recursively averages all the images in a folder. Useful for extracting gray images from a sequence of gray code scans.
Includes ofxProCamToolkit
, which is the core code backing the decoding involved in the other apps. Also PatternGenerator
and GrayCodeGenerator
are responsible for creating the projected patterns used in the other apps. Finally, it includes scenes/
, a variety of generative visuals driven by user interaction. Each of these is used as a test scene for projector alignment.
Camera calibration and gamma calibration information shared between apps is saved here. There is also a small collection of useful shaders.
Demonstrates all of the scenes inside SharedCode/scenes/
.
ProCamToolkit is codeveloped by YCAM Interlab.