The Jahshaka Project OPEN SOURCE VISUAL EFFECTS TECHNOLOGY

1
The Jahshaka ProjectOPEN SOURCE VISUAL EFFECTS
TECHNOLOGY
2
The Jahshaka Project

• The Jahshaka Project is focused on building 3
  core open source technologies
• 1. The Jahshaka famework
• A high level, rapid application development
  infrastructure for the development and deployment
  of powerful multimedia applications, released
  under the GPL.
• 2. The OpenAPI
• A open source API used for developing plugins
  for the Jahshaka framework under any license,
  open or closed, released under the LGPL.
• 3. The OpenLibraries
• A suite of open source libraries focused on
  providing a cross platform, hardware accelerated
  multimedia development framework, released under
  the LGPL.

3

• 1. The Jahshaka Framework
• www.jahshaka.org

4
The Jahshaka Framework

• Jahshaka is a open, extendable, advanced
  multimedia framework
• Allows for advanced, real time multimedia and
  film processing
• Developed and distributed under the GPL
• Full access to the core codebase for
  customization
• Easily skinable from a GUI and workflow
  perspective
• Modular expansion model at numerous levels
• Easily extendable via the openAPI plugin api
• Jahshaka comes complete with
• Built in database driven asset management system
• Media management and playback (from avi to 8k)
• Initial implementations of 3d compositing,
  editing, and paint
• Initial implementations of keyer, color corrector
  and tracker
• Network connectivity and workgroup server

5
The Open Source Model

• Participation Ownership!
• Jahshakas zero-barrier to entry, open source
  model, makes it perfect for large scale
  distribution with the added advantage of
  cross-integration across multiple facilities at
  different levels.
• Its cross platform nature (windows, osx and
  linux) makes it ideal for use in mixed
  environments allowing you to migrate at your
  own pace and not have to worry about loosing
  application support thats tied to the OS.
• Based on open source application development
  model so you can modify and customize the core
  code and tailor it to your workflow with custom
  add-ons, allowing for easy integration into any
  environment.

6
Core Framework Features

• The Jahshaka framework is built on a hardware
  accelerated engine and comes complete with an
  advanced suite of real time digital content
  creation tools.
• Core modules allow for editing, 3d compositing,
  image processing, animation, color correction,
  tracking and encoding.
• Runs on virtually any hardware/operating system
  combination while preserving file, model and data
  transfer to allow for a truly open work
  environment.
• Compatible with popular media formats from AVI
  and Quicktime up to uncompressed 4k, popular
  image formats from PNG and Targa up to DPX, and
  popular 3D formats such as X3D and Colada.
• Mature codebase in development for over 5 years
  takes advantage of advanced technologies such as
  Open GL, GPGPU, databases, network collaboration
  and 64bit processing

7
Project based Features

• The Jahshaka framework comes complete with a
  industrial strength asset management system,
  communication and collaboration tools and network
  connectivity
• Database driven asset management system with full
  metadata tracking allows for management of all
  assets. Easily scaleable to shared external
  databases such as MySQL, DB2 and Oracle.
• Network tools allow users to share files and
  interact in projects seamlessly. Created with the
  focus of allowing film makers to create movies
  securely using the internet as their own private
  network.
• Communication tools tailor the framework to a
  multi user environment with features such as
  instant messaging, video conferencing, voice over
  IP and immersive collaboration.
• Web based Project and group management tie in
  with the frameworks collaboration features to
  allow for the scheduling and monitoring of users
  and assets in large scale production projects.

8
3.0 Release User Interface Concepts
9
Jahshaka 3.0 Architecture
10
Development Model

• Jahshaka itself is a high level api and is
  designed to be implemented as such, allowing
  users and developers to modify it to fit in with
  their pipeline and workflow via the plugin model.
• Based on a highly modular architecture and c
  programming model its is a very easy task to add
  new features on the fly allowing for a high level
  of extensibility.
• The Jahshaka has core support for the OpenAPI
  which allows for integration with proprietary
  technology and algorithims.
• This allows developers to release commercial
  technology that will work seamlessly with the
  Jahshaka tool-set while maintaining its
  proprietary nature.
• The adoption of jahshaka in other vertical
  industries such as the scientific communities,
  the GPGPU industry and broadcast/medical allows
  for a exponentially scaleable technology
  development environment.

11
Whats in it for hollywood?

• Jahshaka can save high end production facilities
  millions of dollars by replacing the high end
  commercial production tools that are currently
  embedded in their production pipelines.
• Its goal is to provide functionality similar to
  the discreet advanced systems (flame, smoke,
  backdraft), avids DS, apples Shake, Piranha s
  64bit paint tools and the Alienbrain asset
  management platform.
• As a open source platform, studios will greatly
  benefit from the ability to write custom features
  directly into the core application for the
  highest level of integration.
• The ability to link against binary plugins will
  enable them to keep in house code private while
  simultaneously taking advantage of the ongoing
  open source development.
• As a maintenance vehicle studios will also be
  able to release their proprietary code when there
  is no longer the need to keep it internal,
  allowing them to take advantage of the open
  source shared global development and maintenance
  model.

12
Other Advantages

• Global user base
• larger user base to chose from who are familiar
  with the core toolset
• Free software saves training of new recruits.
• Sustainability
• Application continue to grow and evolve a long as
  the community exists.
• Unlike traditional applications that get bought
  or acquired and discontinued
• Immediate access to advanced technology
• real-time opengl interaction and gpgpu core
  acceleration
• 64bit processing
• constant stream of new features
• New technologies are adopted as they are released
  
• lower cost of technology maintenance
• core development is continuously advancing
• global open source developer base manages code
• Multi seat savings

13
2. The OpenAPI
14
The OpenAPI

• The OpenAPI is designed to allow studios to mix
  proprietary in house code with open source
  applications
• 1. Extendable Open Source API
• The Open nature of the OpenAPI allows anyone to
  extend it to suit their needs.
• 2. Optimized for Multimedia applications
• Since the OpenAPI is being built by the jahshaka
  project it is optimized for 2D and 3D multimedia
  applications.
• 3. Liberal Licensing
• As a LGPL based library developers can choose to
  release their plugins as binary only

15
3. The OpenLibrarieswww.openlibraries.org
16
The OpenLibraries

• The OpenLibraries are a suite of open source
  libraries focused on providing a cross platform,
  hardware accelerated multimedia development
  framework, released under the LGPL
• 1. Open Source
• As a open source technology the openlibraries
  are suited for high growth in a technology sector
  that is massively divided my different
  programming apis.
• 2. Cross Platform
• In order to empower users looking at alternative
  operating systems the openlibraries have been
  developed from the ground up as a cross platform
  technology.
• 3. Easily Extendable
• The openlibraries are built on a plugin based
  framework for maximum extendability, and support
  both commercial and non commercial plugins

17
What are they?

• The OpenLibraries provide developers with the key
  building blocks they need to easy build, test and
  deploy advanced, rich media applications.
• They are all built on a core open standard for
  the definition of assets, the open asset standard
  (OAS) that provides developers with the ability
  to easily work with assets both locally and
  across the network
• The OpenLibraries are truly cross platform and
  currently support Linux, OsX, and Windows, and
  are licensed to the public under the GNU LGPL
  (Library GPL) agreement
• The OpenLibraries can be used for the development
  of
• Non-linear editing applications
• 2D and 3D Compositing applications
• 2D and 3D players
• Image processing applications
• Rich-media applications
• Web deployment of services and content

18
The OpenLibraries consist of 6 core libraries and
a common, shared plugin interface to allow for
easy expansionThe openAssetLib - a powerful
library for defining assets in a truly cross
platform manner that allows you to create,
categorize and manage assets in a variety of
databases.The openObjectLib - a powerful
library for the handling of 3d objects and scenes
in a truly cross platform manner, it is based
around a high level scenegraph. The
openImageLib - a powerful image management
toolkit that allows you to support a wide range
of image formats within your applications. The
openMediaLib - a powerful library for the
handling of media in a truly cross platform
manner, it allows you to encode and decode a wide
variety of media files and formatsThe
openEffectsLib - a powerful library for
harnessing the power of your CPU and GPU in a
truly cross platform manner, based on a real time
image processing core.The openNetworkLib - a
powerful library for network asset management and
communication, it allows you to easily integrate
a variety of networking technologies. The
openPluginLib - a powerful plugin API designed to
give developers a common interface for the
development of OpenLibraries plugins.
19
Architecture

• The OpenLibraries are based on a advanced
  architecture that utilizes the best of modern day
  programming technologies, toolkits and APIs
• Written in C
• Using the latest in c coding techniques
• Uses boost for powerful underlying architecture
• GPU-based
• For lightning fast acceleration
• CPU optimised
• Multi-core architectures
• Distributed memory machines (?)
• Cross platform
• Runs on Linux, Mac, Win, and other flavours of
  Unix
• Plugin extensible
• Built on top of a highly extensible plugin api
• Compatible with commercial code
• Allows commercial extensions of core framework
• While maintaining compatibility with LGPL/GPL

20
OpenObjectLib

• The OpenObjectLib implements a scene graph API
  for realtime 3D graphics. It is implemented in
  C using generic programming techniques and it
  has uses in 3D scene transcoding and compositing,
  games and visual simulation.
• Its architecture is centered around the use of
  GPUs not only for rendering but also for general
  purpose algorithms. It can be used with no
  restrictions on commercial and non-commercial
  applications and is licensed under the LGPL.
• FEATURES
• 3D scene support
• Collada, X3D, NVB, FLT
• DCC and Visual Simulation
• 3D Compositing
• Traditional film rendering
• NVIDIAs Gelato
• Based on state of the art research
• SIGGRAPH

21
OpenImageLib

• The OpenImageLib implements a library for the
  serialisation and transcoding between image
  formats.
• It is implemented in C using generic
  programming techniques and it has uses in any
  application or code that uses or manipulates
  images, both 2D and 3D. It can be used with no
  restrictions on commercial and non-commercial
  applications and is licensed under the LGPL
• Image formats
• All you would expect (!)
• DPX and Cineon
• OpenEXR
• Image Generators

22
OpenEffectsLib

• The OpenEffectsLib implements a library for 2D
  compositing and image processing. It is
  implemented in C using generic programming
  techniques and it has uses in any application or
  code to implement what is commonly known as
  node-based compositing.
• The OpenEffectsLib describes a directed acyclic
  graph suitable for an image processing and
  compositing pipeline. It has a plugin centred
  architecture that allow for easy extension of
  both its operators and sources.
• Compositing
• Traditional Compositing
• Adobe filters
• Keying
• HDR pipeline
• CPU and GPU optimized

23
OpenMediaLib

• The OpenImageLib implements a library for the
  serialisation and transcoding between media
  formats.
• It is implemented in C using generic
  programming techniques and it has uses in any
  application or code that uses or manipulates
  media files, both compressed and uncompressed. It
  can be used with no restrictions on commercial
  and non-commercial applications and is licensed
  under the LGPL
• Non-linear editing
• Video and Image Sequences
• Audio/Video Transcoding
• Audio/Video Encoding

24
DCC Integration
The OpenLibraries are built with the concept of
DCC integration in place from the ground up,
making it a simple matter to both embed them in
existing applications, as well as to extend them
with plugins to support the applications you use
today