Blog: [Blog Home] [Archives] [Search] [Contact]

Posts Tagged ‘video’

Pierre-Auguste Renoir The Umbrellas Algorithmic Interpretation Video

Saturday, December 2nd, 2017

Pierre-Auguste Renoir The Umbrellas Algorithmic Interpretation Video
Pierre-Auguste Renoir The Umbrellas Algorithmic Interpretation Video

I just created a video for the first time in quite a while for my YouTube account. It came about when I was experimenting with algorithmic representations of a source image using the Processing programming language. The image I happened to be working with was “The Umbrellas”, a painting by Pierre-Auguste Renoir.

As I worked with variations on the algorithm it struck me that an animation could be interesting. The basics of the algorithm were to first create a grid of equally spaced points and assign each a x,y location. The key variable at this point was the amount of spacing there would be between each x,y grid location. For this video I set the grid spacing to be 10 pixels.

Next was to get the color value from Renoir’s “The Umbrellas” image for each of the x,y locations in the grid. To draw I had decided to use the line() function. The variables for each line would be color, starting angle, and length. For the line’s color, I simply used the color value taken from the image for that location. For the starting angle of rotation, I opted to use the hue taken from the corresponding pixel. To get the hue required converting the RGB color value into its HSB (hue, saturation, brightness) equivalent. The length of the each line being drawn was determined by the brightness of the pixel at that location. This resulted in another variable: establishing what the maximum line length would be. So brightness values of 0 to 255 had to be translated into a range of lengths from some minimum value to some maximum value. The standard way of doing this in Processing is to use the map() function. I never use map() because it is an inefficient way to translate numbers from one scale into another scale. For the video, I simply divided the pixel brightness by 12 – meaning the longest a line could be was 21 pixels.

To add some variability, I added a variable for the Z axis and used a Perlin noise field to control each location’s Z coordinate. The result is that the distance of each line from the camera varies somewhat, which enhances the perception of depth in the image.

To animate the image required changing one or more of the variables associated with each grid point over time. Keeping things simple, I added a global variable that would equally increment each line’s rotation angle between frames. This created a uniform rotation for all the lines.

I then added a time variable to alter the Perlin noise field values over time and updated each line’s Z coordinate between frames. The main issue here was with respect to how much I wanted the range of Z values to vary. For comparison, below is an illustration of what you would see if a substantially greater range of Z coordinate values was allowed.

Pierre Auguste Renoir The Umbrellas Algorithmic Interpretation Video Variation
Pierre Auguste Renoir The Umbrellas Algorithmic Interpretation Video Variation

To create the output, I used the Processing saveFrame() feature to write each frame of the movie to a tiff file. Separately I had used Audacity to create a narration soundtrack for the video. Once I knew how long my audio track was, I simply dropped a variable into my Processing program which indicated the frameCount at which to stop generating image frames.

While I have previously used tools like FFMPEG to create videos, this time I decided to use Processing’s Movie Maker tool. Confirming that my tiff and mp3 files were fine, I started up Movie Maker. I specified the input sources for my files, went with the default compression of animation and clicked the “Create Movie” button. I then monitored the dialog window as the program progressed through the 3000 images used to create the video. The program ended without error.

But when I went to view the video using VLC, all I got was a black screen and horribly garbled and spotty audio. I had no idea what had gone wrong. Rather than resorting to one of my other tools, I opted to give Movie Maker another try. The only difference was that this time I selected the JPEG option for compression. The dialog proceeded as before and again ended without error. This time the video and audio were fine, except for a narrow strip of color along the video’s edge. For purposes of this video, that is something I can live with.

Unfortunately the image quality of the video has suffered due to YouTube’s overly enthusiastic image compression. Whereas my original video upload was a 3.1 gigabyte file, YouTube compressed it down to a mere 29 megabytes (you can’t throw away that much information without losing quality). While I do understand the need to economize on bandwidth, such economies can be achieved in part by viewing the video at one of the lower resolution settings.

You can view the video on YouTube at: https://youtu.be/CNE0j1LXIJ0. Give the video a watch, let me know what you think, and share it if you like it.

 

Bookmark it:  Stumble It  Bookmark this on Delicious  Digg This  Technorati  Reddit Tweet It


Enhanced Vision – Digital Video

Saturday, May 9th, 2015

Digits digital video image still
Image Still from the Digits digital video

I received an email the other day from ACM SIGGRAPH Digital Arts Community of which I am a member. The email alerted me to a new ACM SIGGRAPH (Association of Computing Machinery Special Interest Group-Graphics) project. Titled Enhanced Vision – Digital Video, it is billed as "an international survey of today’s most exciting and innovative digitally-enhanced video art works". The thirty videos included in this exhibition were curated by a committee of ten experts in the field.

The videos are supposed to tell a story – some worked, some didn’t. Be that as it may, my focus was on the imagery itself and the technical skills and imagination that went into their creation. On this level, a number of the videos did not my level of expectations.

While I watched all the videos, I have opted to comment only on certain ones. The list of videos and my comments follow.

  • 366
  • Apotheosis of Glasgow High-rises
  • Arcadia
  • A Small Fee
  • A Written Perspective – in black and white, it appears to have used thresholding and/or edge finding to process a standard video. While it has no soundtrack, this was one of the more visually interesting videos with its white on black outlines flickering across the screen.
  • City.Flow() – also visually interesting. Its use of multiple exposure video of urban activity made for an interesting visual effect that lent itself to the story the video was telling.
  • Composition Fukushima 2011
  • Deephorizon
  • Digits – visually the most interesting with varied image processing techniques applied to the video. Identified as a "video that refers to the symbolism of ten numbers", it featured a short individualized segment for each number.
  • Don’t Know Where To Point
  • Fashion To Die For – used no image processing or CGI (computer-generated imagery) but did have a very interesting opening with its use of video taken of machinery in a garment factory that was fascinating to watch with its spinning spindles of thread.
  • Filament
  • Grotesques
  • Horribile Pictu 1
  • Mudland #1 – a striking video, it is both visually surreal and bizarre – I like it. Its strength is its very imaginative use of compositing.
    Mudland #1 digital video image still
    Image Still from the Mudland #1 digital video.
  • My Meds, from the series Testament
  • necrolog of robin williams or the suicide of irony
  • Not To Scale At All
  • On China Sea – a visually interesting video of the motion of water in the wake of a ship.
  • OU TOPOS
  • Particle Daydreams
  • Printed Clothes DIY (4 my catcaller)
  • Raw Quinoa
  • Shatter/Flood/Mud/Houses
  • Simulacrum
  • Slip Away
  • Soft Pong Inari
  • Surveillance Siddhi
  • The Dust Machine Variation – probably the most sophisticated of the videos, it also easily had the most sonically interesting and imaginative sound track.
  • Water

If you are a maker of videos then you should give these a look. Each video comes with a brief description as well as a list of the software that was used in its creation. You may also want to contact a video’s creator(s) to learn more about how the created their work.

All the videos are accessible from the Enhanced Vision – Digital Video Collection

Happy Screening

Bookmark it:  Stumble It  Bookmark this on Delicious  Digg This  Technorati  Reddit Tweet It


Video: The Liquified Paintings of Claude Monet

Monday, July 7th, 2014

Liquified Paintings of Claude Monet
The Liquified Paintings of Claude Monet Video

Since setting up an account on YouTube towards the end of last year, I confess to not having been active on that platform. I created the account for the purpose of publishing several video portfolios to promote my art. The plan was to create a video for each area of artistic creation I am working in. I created exactly one portfolio video and that was for my portrait art. That was my first attempt at making a video and you can see it here: Portrait Art Video. If you’re interested in the story of how I went about making that video, read Portrait Art Video Project.

The experience of creating that video got me interested in creating some original animations of my own. Since that time I’ve only posted two videos exploring animation. One I dubbed the Swimming Eye Art Video. The other was a crude quickie experiment in animating an image – Sailing A Stormy Sea Video.

For this new video I wanted to create something that would feature the art of the great impressionist painter Claude Monet. I have recently been experimenting with vector fields and their utility as an algorithmic means of creating flowing brush strokes. It occurred to me that I could use this technique to create a series of liquified paintings that would evolve. And that’s how The Liquified Paintings of Claude Monet video was born. And here it is.

The video captures the evolution of six separate paintings and the transition from one to the next. For me it is the transition between paintings that is visually the most interesting. One thing you may have noticed is the very slow evolution of the first painting. It is no coincidence that this first painting is the darkest of the six paintings. You see I tied the speed of evolution to the overall brightness of the image.

Given that these paintings have been "liquified", I deliberately chose artworks by Monet that featured water, be it a pond, a stream, a river, or the ocean. Following are image stills from the video and the name of the Monet painting that was used as the color source at that point during the video.

Claude Monet Impression, Soleil Levant
Claude Monet – Impression, Soleil Levant

Claude Monet The Argenteuil Bridge
Claude Monet – The Argenteuil Bridge

Claude Monet Morning By The Sea
Claude Monet – Morning By The Sea

Claude Monet Autumn On The Seine At Argenteuil
Claude Monet – Autumn On The Seine At Argenteuil

Claude Monet Poplars At The Epte
Claude Monet – Poplars At The Epte

Claude Monet Water Lilies
Claude Monet – Water Lilies

The most time consuming aspect of this project was writing the program that produced the video stills. In all I used 3272 image stills (not counting the title and trailer images) to create this video.

Graphics Software Used

I created this video using several different software packages. The liquified/animated images used to construct the video were created with a program I wrote using the Processing creative coding platform which is a framework built on Java. As a programming language, Processing is easily the best language for non-programmers interested in creative coding projects. To stitch the individual images together into a video, I used the DOS command line utility FFMPEG. To create my title and trailer images I used Adobe Photoshop CS4. Note that my workflow would have consisted entirely of "free" software if I had used GIMP (GNU Image Manipulation Program) to create these two images. For the soundtrack file, I used Audacity to edit the mp3 sound file.The soundtrack music is Laideronnette Imperatrice Des Pagodes by Maurice Ravel. Finally to assemble everything I used Microsoft’s Windows Live Movie Maker which came bundled with Windows 7.

In Conclusion

If you would like to know more about Claude Monet, you may want to read this biography of Claude Monet. If you are of a technical bent, there is this Wikipedia entry for vector fields which served as the painting foundation upon which my Processing program was built. And while I don’t often add new videos, you may want to follow me on YouTube.

I’ll close with a couple of noteworthy quotes.

When you go out to paint, try to forget what objects you have before you – a tree, house, a field….Merely think, here is a little square of blue, here an oblong of pink, here a streak of yellow, and paint it just as it looks to you, the exact color and shape, until it gives your own naive impression of the scene before you. – Claude Monet

A preliminary drawing for a wallpaper pattern is more highly finished than this seascape. – French art critic Louis Leroy in 1874 commenting on Monet’s Impression, Sunrise

Bookmark it:  Stumble It  Bookmark this on Delicious  Digg This  Technorati  Reddit Tweet It


Swimming Eye Video

Monday, December 16th, 2013

Swimming Eye Video
Swimming Eye Video

I’ve just completed a video project titled Swimming Eye. This was yet another accidental project on my part as I was not planning on creating a video. Rather I was experimenting with using Processing to create an algorithmic painting program.

In experimenting with applying Perlin noise to a gridded particle field to create a large algorithmic paintbrush, I was struck my the nature of the ensuing motion. It was similar to that of a liquid surface in motion. The impression it made on me was that of a living painting: it wasn’t a static image but an image that had a life of its own.

My original idea of creating some rather unusual digital paintings using this methodology was replaced with the idea of creating a video. The image used as illustration above is representative of my original idea. It was created by stacking several individual movie frames together in Photoshop and using different layer blend modes to merge the individual images together.

Previously I wrote about using Windows Live Movie Maker to create a YouTube video (see Portrait Art Video Project). However I found that Movie Maker was not capable of turning jpeg images into a real movie. With Movie Maker, an image must remain on display for at least one second. This is fine if you want to use images to create a video slide show. However, it does not work when it comes to creating an animation. To translate my 1400 images into a movie, I wanted each image (frame) to display for 1/30th of a second (think 30 frames per second).

I tried using Avidemux but it crashed repeatedly. In searching I came across FFMPEG – a DOS command line utility. It worked. With the basic video created my next step was to come up with a soundtrack because I really didn’t want to create a silent movie.

Searching opsound.org, I located a public domain song that met my needs (thanks to Free Sound Collective for making their music available for use). I used Audacity to create a sound clip of the necessary time length. I used Movie Maker to add the mp3 to the video created by FFMPEG.

I hope you enjoy the show.

Don’t forget – art is in the eye of the beholder.

See the Swimming Eye Video on YouTube

Bookmark it:  Stumble It  Bookmark this on Delicious  Digg This  Technorati  Reddit Tweet It


Portrait Art Video Project

Friday, September 20th, 2013

Portrait Art Video
Portrait Art Video

Last week I wrote about making and posting my first video to YouTube
in Learning YouTube and Movie Maker. Earlier this week I posted my second video – The Digital Portrait Art of Jim Plaxco – a promotional video for my portrait art.

Let me tell you about the process I used to create this video. First I knew that I wanted the video to be not much longer than two minutes. Next I estimated how long I wanted each artwork to be displayed in the video. These two pieces of information told me exactly how many of my artworks I could use for the video.

My next step was to create the individual jpegs that would be used to create the video. I used Adobe Bridge to select the art that I wanted to use for the video. I then used Adobe Photoshop’s Image Processor (Adobe Bridge -> Tools -> Photoshop -> Image Processor) and the Resize to Fit option to create uniformly sized jpegs. I then created a title slide and a credits slide for the video, again using Adobe Photoshop.

Next was to bring all the jpegs into Windows Live Movie Maker. It was at this point that I sorted the pictures into the order I wanted. Once I had finished ordering the portraits in Movie Maker, I next applied a transition effect to each image. I tried to apply effects that I felt would work nicely for the artwork being transitioned from and to. Lastly I adjusted the display time settings associated with each image. Since I wanted to use a uniform display time for all the artwork in the show, I used Ctrl-A to select all the images and then used the Edit feature to set a uniform display time. I then individually selected the opening title slide and closing credits slide to give them a longer display time. At this point the visual portion of the video was complete. I exported the video and then watched it to decide if the timing and transitions were all to my satisfaction. To watch the movie I used my video player of choice – VLC Media Player

Adding sound to my video

At this point I had a silent movie. Now that I knew the movie’s final length (2:37), I had to locate suitable music of at least that duration. While I could have looped a shorter audio to fill out the video, I wanted to avoid that. Regarding music, there are several web sites that offer music under the creative commons license. Even though I limited my search to creative commons licenses that allow for commercial use (non-commercial licenses dominate) just to be 100% safe, I was still able to find a nice selection of music.

A note to those interested in using music with a creative commons license – it is important that you follow the creative commons licensing terms. The musicians are providing something for nothing except an acknowledgment in the work you produce. You know – that thing artists hate to hear — "can I use your art for free – you’ll get good exposure." These musicians have said yes so be sure to give them their proper credit in your video.

I found a very nice selection of music on opsound.org music web site. One song I found particularly appropriate was Big (Astronaut Mix) by Dave Howes. Big (Astronaut Mix) was a little bit longer than my video so I turned to Audacity. Audacity is excellent, free, open source, audio editing software. Being able to use Audacity to edit the soundtrack was wonderfully simple. There were only two things I had to do in Audacity. The first was to crop the soundtrack’s length to exactly match the length of my video. The second was to apply a fade effect to the end of the soundtrack so that the audio would fade out in the final seconds of the video.

With a soundtrack ready to go, I reopened my Movie Maker project, imported the mp3 file, and once again exported the video. It was just that simple.

With my video completed, it was time to turn to YouTube. While the video upload was in progress, I gave the YouTube entry for the video an appropriate title: The Digital Portrait Art of Jim Plaxco and an appropriate description:

A video presentation of digital portrait art created by Jim Plaxco. For details and a list of the art used, see http://www.artsnova.com/portrait-art-video.html.

Soundtrack: Big (Astronaut Mix) by Dave Howes, http://opsound.org

Also, rather than use one of YouTube’s random frame choices for the video’s thumbnail, I went with the custom thumbnail option and selected the jpeg of my video’s title slide.

I must confess that the entire project was rather a stress-free, enjoyable exercise. If you are an artist and have contemplated creating your own video to promote your art, what are you waiting for? The tools are free and the time investment in creating a video similar to mine is not bad at all.

Watch the video
The Digital Portrait Art of Jim Plaxco Video

Bookmark it:  Stumble It  Bookmark this on Delicious  Digg This  Technorati  Reddit Tweet It


Learning YouTube and Movie Maker

Wednesday, September 11th, 2013

Movie Maker Masters of Lightning Screen Shot
Movie Maker Masters of Lightning Screen Shot

I’ve decided to dive into the world of publishing videos on YouTube. I had given it some thought last year after creating a CG animation but took no action. I recently created another animation and decided it was time to take action. The videos I have or plan to create are of four types:

  1. computer graphic animations I’ve created
  2. instructional CG videos based on lectures I’ve given
  3. promotional CG videos for my art
  4. videos I’ve shot at events

Before publishing any videos to YouTube I decided to do some research – which led to a trip to the library. I came away with the following books:

  • Conquering YouTube by Jay Miles, 2011
  • YouTube and Video Marketing An Hour A Day by Greg Jarboe, 2012
  • YouTube for Business, Online Video Marketing for Any Business by Michael Miller, 2009

The library had more but given the rate of change, I ignored all older books on the subject. As it was I almost took a pass on YouTube for Business as 2009 qualifies as ancient.

Conquering YouTube wins my award for Most Misnamed Book. Going through the book it became clear that the only reason that YouTube was in the title was for the book’s own marketing purposes. The book has absolutely nothing to do with YouTube. Rather it is a book of tips for creating live action videos. As a book on how to use your video camera to frame and light a scene, create special effects, and to construct a movie, the book succeeds but the book’s content ends there. Video file formats are not discussed. Post-processing on the computer is not discussed. Video software is not discussed. And using YouTube to host your video is never mentioned.

Briefly looking over YouTube for Business, Online Video Marketing for Any Business, it appears to be exactly what I was looking for with sections on:

  • Marketing Your Business Online with YouTube
  • Producing Your YouTube Videos
  • Managing Your YouTube Videos
  • Working with YouTube Video Blogs
  • Promotion and Monetization

With a publication date of 2009, there is a fair chance that some of the information is no longer accurate. For that reason I decided to focus on YouTube and Video Marketing An Hour A Day by Greg Jarboe and published last year.

Before getting into the book, I decided it would be better to first get some hands-on experience by uploading and sharing a video. Fortunately I had a video of a Masters of Lightning singing tesla coils performance collecting electronic dust on my computer. My first task was to create a title and a closing jpeg image for the video. Yes it is extra work, but it does provide the viewer with useful information and it clearly establishes the ownership of the video. To create the title and credits images I used Photoshop. This consisted of taking a screen shot of a frame from the video, adding the text, and using a layer style to enhance the text’s visual appeal.

I hate to say it but I used Microsoft’s Windows Live Movie Maker to attach the two jpegs to the video file and create the initial transition effect. Unfortunately Movie Maker only allows you to save your video as a WMV (Windows Media Video). No problem though as YouTube accepts WMV files. Uploading and filling in the required fields on YouTube was a piece of cake. The video that follows is that video.

Masters of Lightning play the Dr Who theme song at the Duckon Science Fiction Convention

Having created and published this video, I’ve started in on YouTube and Video Marketing An Hour A Day which contains the following chapters:

  1. A Short History of YouTube
  2. Map Out Your Video Marketing Strategy
  3. Month 1: Make Videos Worth Watching
  4. Month 2: create Content Worth Sharing
  5. Month 3: Customize Your YouTube Channel
  6. Month 4: Explore YouTube Alternatives
  7. Month 5: Optimize Video for YouTube
  8. Month 6: Engage the YouTube Community
  9. Month 7: Trust but Verify YouTube Insight
  10. Study YouTube Success Stories
  11. A Quick Look at the Future

This looks to be exactly the sort coverage that I was looking for. According to Greg Jarboe, the book’s author, "over three billion videos are streamed every day on YouTube." Creating a video and getting it watched on YouTube represents quite a challenge. From the book: "… more than 70 percent of all videos on YouTube make up only 1 percent of the views on the site." meaning that less than 30 percent of all videos get 99 percent of the view traffic. Clearly a challenge for every video creator out there.

Windows Live Movie Maker Tips

There are two things I’ve discovered with my initial work with Windows Live Movie Maker that I’d like to share with you.

Movie Maker Tip 1

Let’s say that you’ve imported an image into your video. Let’s also say you’re unhappy with it so you go back and make a change to the image. Movie Maker will not recognize that change. In fact if you delete the image from your video and re-import it, Movie Maker will recognize that you previously imported that image and will use its cached version instead of the file you’ve updated. I found that what worked was to save the image with a new file name and import that new file into the movie.

Movie Maker Tip 2

With respect to image resources on your computer that you have imported into your Movie Maker project, Movie Maker does not make its own copy of them inside the video. Rather it relies on linking to where the resources were at the time you imported them into Movie Maker. If you subsequently move these resources to a different directory or drive, the next time you open your project, you will see empty gray boxes where your images used to be. You will need to double-click each and every box individually to open a Windows Explorer dialog so that you can tell Movie Maker where that image is now located. My tip: make sure you keep all your resources for each video together with that video project. This makes me wonder about tip 1 – what would have happened if I had closed Movie Maker, modified the image file, and then reopened Movie Maker and the project.

Closing Thoughts

It’s always fun to learn something new on the computer and to acquire new skills. I expect that the next video I release will be a work that promotes my portrait art. For that video I’ll need to come up with a sound track – which represents yet another challenge. I hope that I”m up to it.

Bookmark it:  Stumble It  Bookmark this on Delicious  Digg This  Technorati  Reddit Tweet It