Author Archives: Scott

Draw a line based on a color in a video

Posted on August 11, 2015 | Comments Off

// Smoother color tracking
// based on Dan Shiffman & Dan O'Sullivan's examples

import processing.video.*;

// Variable for capture device
Capture video;

PGraphics drawing; /// a contect to hold the "drawing"
PImage vidMirror;


// A variable for the color we are searching for.
color trackColor; 
float thresh = 20; 
int avgX, avgY;  //this is what we are trying to find
int prevAvgX, prevAvgY;

void setup() {
  size(640, 480);
  video = new Capture(this, width, height);
  video.start();
  // Start off tracking for red
  trackColor = color(255, 0, 0);

  // instance of the drawing 
  drawing = createGraphics(width, height);
  
  vidMirror = new PImage(video.width, video.height);

}

void draw() {
  // Capture and display the video
  if (video.available()) {
    video.read();
  }
  video.loadPixels();
//  image(video, 0, 0);

 for(int x = 0; x < video.width; x++){
    for(int y = 0; y < video.height; y++){
      vidMirror.pixels[x+y*video.width] = video.pixels[(video.width-(x+1))+y*video.width];
    }
  }
  
  vidMirror.updatePixels();
  image(vidMirror,0,0);

  //we are going to find the average location of changed pixels so
  //we will need the sum of all the x find, the sum of all the y 
  // find and the total finds
  int totalFoundPixels= 0; 
  int sumX = 0;  
  int sumY = 0;

  // Begin loop to walk through every pixel
  for (int x = 0; x < vidMirror.width; x ++ ) {
    for (int y = 0; y < vidMirror.height; y ++ ) {
      int loc = x + y*vidMirror.width;
      // What is current color
      color currentColor = vidMirror.pixels[loc];
      float r1 = red(currentColor);
      float g1 = green(currentColor);
      float b1 = blue(currentColor);

      // colors we are looking for
      float r2 = red(trackColor);
      float g2 = green(trackColor);
      float b2 = blue(trackColor);

      // Using euclidean distance to compare colors
      float difference = dist(r1, g1, b1, r2, g2, b2); 
      // We are using the dist( ) function to compare the current 
      // color with the color we are tracking.

      // If current color is more similar to tracked color than
      // closest color, save current location and current difference
      if (difference < thresh) {
        sumX = sumX + x;
        sumY= sumY + y;
        totalFoundPixels++;
      }
    }
  }

  // average the locations of all the pixels that were close enough. 
  if (totalFoundPixels > 0) {
    avgX = sumX/totalFoundPixels;
    avgY = sumY/totalFoundPixels;
    // Draw a circle at the tracked pixel
    fill(trackColor);
    strokeWeight(4.0);
    stroke(0, 127);
    ellipse(avgX-10, (avgY-10), 20, 20);
  }

  drawing.beginDraw();
  // Draw a large, yellow circle at the brightest pixel
  drawing.stroke(trackColor);
  //  drawing.noStroke();
  strokeWeight(3);
  drawing.line(prevAvgX, prevAvgY, avgX, avgY);
  drawing.endDraw();
  blend(drawing, 0, 0, width, height, 0, 0, width, height, ADD);

  prevAvgX = avgX;
  prevAvgY = avgY;
}

void mousePressed() {
  // Save color where the mouse is clicked in trackColor variable
  int loc = mouseX + mouseY*vidMirror.width;
  trackColor = vidMirror.pixels[loc];
}


void keyPressed() {
  //for adjusting things on the fly
  if (key == '-') {
    thresh--;
    println("Threshold " + thresh);
  } else if (key == '=') {
    thresh++;
    println("Threshold " + thresh);
  }
}

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

// Smoother color tracking

// based on Dan Shiffman & Dan O'Sullivan's examples

import processing.video.*;

// Variable for capture device

Capture video;

PGraphics drawing; /// a contect to hold the "drawing"

PImage vidMirror;

// A variable for the color we are searching for.

color trackColor;

float thresh = 20;

int avgX, avgY; //this is what we are trying to find

int prevAvgX, prevAvgY;

void setup() {

size(640, 480);

video = new Capture(this, width, height);

video.start();

// Start off tracking for red

trackColor = color(255, 0, 0);

// instance of the drawing

drawing = createGraphics(width, height);

vidMirror = new PImage(video.width, video.height);

}

void draw() {

// Capture and display the video

if (video.available()) {

video.read();

}

video.loadPixels();

// image(video, 0, 0);

for(int x = 0; x < video.width; x++){

for(int y = 0; y < video.height; y++){

vidMirror.pixels[x+y*video.width] = video.pixels[(video.width-(x+1))+y*video.width];

}

vidMirror.updatePixels();

image(vidMirror,0,0);

//we are going to find the average location of changed pixels so

//we will need the sum of all the x find, the sum of all the y

// find and the total finds

int totalFoundPixels= 0;

int sumX = 0;

int sumY = 0;

// Begin loop to walk through every pixel

for (int x = 0; x < vidMirror.width; x ++ ) {

for (int y = 0; y < vidMirror.height; y ++ ) {

int loc = x + y*vidMirror.width;

// What is current color

color currentColor = vidMirror.pixels[loc];

float r1 = red(currentColor);

float g1 = green(currentColor);

float b1 = blue(currentColor);

// colors we are looking for

float r2 = red(trackColor);

float g2 = green(trackColor);

float b2 = blue(trackColor);

// Using euclidean distance to compare colors

float difference = dist(r1, g1, b1, r2, g2, b2);

// We are using the dist( ) function to compare the current

// color with the color we are tracking.

// If current color is more similar to tracked color than

// closest color, save current location and current difference

if (difference < thresh) {

sumX = sumX + x;

sumY= sumY + y;

totalFoundPixels++;

}

// average the locations of all the pixels that were close enough.

if (totalFoundPixels > 0) {

avgX = sumX/totalFoundPixels;

avgY = sumY/totalFoundPixels;

// Draw a circle at the tracked pixel

fill(trackColor);

strokeWeight(4.0);

stroke(0, 127);

ellipse(avgX-10, (avgY-10), 20, 20);

}

drawing.beginDraw();

// Draw a large, yellow circle at the brightest pixel

drawing.stroke(trackColor);

// drawing.noStroke();

strokeWeight(3);

drawing.line(prevAvgX, prevAvgY, avgX, avgY);

drawing.endDraw();

blend(drawing, 0, 0, width, height, 0, 0, width, height, ADD);

prevAvgX = avgX;

prevAvgY = avgY;

}

void mousePressed() {

// Save color where the mouse is clicked in trackColor variable

int loc = mouseX + mouseY*vidMirror.width;

trackColor = vidMirror.pixels[loc];

}

void keyPressed() {

//for adjusting things on the fly

if (key == '-') {

thresh--;

println("Threshold " + thresh);

} else if (key == '=') {

thresh++;

println("Threshold " + thresh);

}

Comments Off on Draw a line based on a color in a video

Posted in Processing

Swap out a color with another one in a video

Posted on August 11, 2015 | Comments Off

import processing.video.*;

// Variable for video file
Movie movie;

// A variable for the color we are searching for.
color trackColor; 
float thresh = 20; // threshold for the pixels we will change

color randColor; // random color

void setup() {
  size(640, 480);
  movie = new Movie(this, "aVideo.mov"); // load a movie
  movie.loop();
  // Start off tracking for red
  trackColor = color(255, 0, 0);
}

void movieEvent (Movie m) {
  m.read();
}  

void draw() {
  loadPixels(); // load the pixels of the canvas
  movie.loadPixels();  // load the pixels of the movie

  // generate a random color for every frame of draw
  randColor = color(random(255), random(255), random(255));

  // Begin loop to walk through every pixel
  for (int x = 0; x < movie.width; x ++ ) {
    for (int y = 0; y < movie.height; y ++ ) {
      int loc = x + y*movie.width;
      // What is current color
      color currentColor = movie.pixels[loc];
      float r1 = red(currentColor);
      float g1 = green(currentColor);
      float b1 = blue(currentColor);
      float r2 = red(trackColor);
      float g2 = green(trackColor);
      float b2 = blue(trackColor);

      // Using euclidean distance to compare colors
      float d = dist(r1, g1, b1, r2, g2, b2); 
      // We are using the dist( ) function to compare the current 
      // color with the color we are tracking.

      // If current color less than the threshold, change it to the random color
      // if it'd greater, use the movie pixel
      if (d < thresh) {
        pixels[loc] = randColor;
      } else {
        pixels[loc] = currentColor;
      }
    }
  }
  updatePixels();
}

void mousePressed() {
  // Save color where the mouse is clicked in trackColor variable
  int loc = mouseX + mouseY*movie.width;
  trackColor = movie.pixels[loc];
}

import processing.video.*;

// Variable for video file

Movie movie;

// A variable for the color we are searching for.

color trackColor;

float thresh = 20; // threshold for the pixels we will change

color randColor; // random color

void setup() {

size(640, 480);

movie = new Movie(this, "aVideo.mov"); // load a movie

movie.loop();

// Start off tracking for red

trackColor = color(255, 0, 0);

}

void movieEvent (Movie m) {

m.read();

}

void draw() {

loadPixels(); // load the pixels of the canvas

movie.loadPixels(); // load the pixels of the movie

// generate a random color for every frame of draw

randColor = color(random(255), random(255), random(255));

// Begin loop to walk through every pixel

for (int x = 0; x < movie.width; x ++ ) {

for (int y = 0; y < movie.height; y ++ ) {

int loc = x + y*movie.width;

// What is current color

color currentColor = movie.pixels[loc];

float r1 = red(currentColor);

float g1 = green(currentColor);

float b1 = blue(currentColor);

float r2 = red(trackColor);

float g2 = green(trackColor);

float b2 = blue(trackColor);

// Using euclidean distance to compare colors

float d = dist(r1, g1, b1, r2, g2, b2);

// We are using the dist( ) function to compare the current

// color with the color we are tracking.

// If current color less than the threshold, change it to the random color

// if it'd greater, use the movie pixel

if (d < thresh) {

pixels[loc] = randColor;

} else {

pixels[loc] = currentColor;

}

updatePixels();

}

void mousePressed() {

// Save color where the mouse is clicked in trackColor variable

int loc = mouseX + mouseY*movie.width;

trackColor = movie.pixels[loc];

}

Comments Off on Swap out a color with another one in a video

Posted in Processing

I’ve got no strings

Posted on August 6, 2015 | Comments Off

Wireless communication is pretty rad. At the end of the day though, it’s all about radios that act as modems. A modem is a device that takes digital information (like serial communication) modulates these signals for transmission, the demodulates them on the other end to feats on the gooey insides of the signal.

We have a number of options for wireless communication, we’ll start easy, and move our down the ladder of difficulty.

Bluetooth : a pretty simple protocol that can be used to transmit data like sensor information, but also more complex signals like audio. The modems used with the Arduino are pretty simple and just create a serial connection between the computer and the microcontroller
- blue fruit ez-link
  - Pair modem and computer
  - auto configures baud rate
- sparkfun’s bluesmirf is a good choice too
Xbee : slightly more complex. Modems need to be configured to communicate with each other.
- configure serially
  - easiest with a usb-serial adapter
  - CoolTerm is great for talking with the modems (key emulation to CR)
  - Put into command mode with “+++”
  - ATID (PAN ID number)
  - ATMY (self ID)
  - ATDH (destination high)
  - ATDL (destination low)
  - ATWR (saves)
  - Xbee shield needs to be on USB switch
GSM (similar to WiFi & Ethernet, but much cooler)

Comments Off on I’ve got no strings

Posted in Lateral Thinking with Withered Technology

Putting it all together

Posted on August 4, 2015 | Comments Off

Code from class, circuit schematics, etc. are at the bottom

Let’s get the chocolate in the peanut butter

Continue reading →

Comments Off on Putting it all together

Posted in Arduino, Class notes, Lateral Thinking with Withered Technology, Processing

Images

Posted on July 30, 2015 | Comments Off

Download this folder

loadPixels()
updatePixels()
pixels[]
PImage
- loadImage()
- can be local or remote
- image()
tint()
- opacity, etc.
Video
- Capture class

import processing.video.*;
Capture video;

void setup() {
  size(320,240);
  video = new Capture(this,width,height);
  video.start(); // you might not see this in older examples
}

void draw() {
  // Capture and display the video
  if (video.available()) {
    video.read();
  }
  image(video,0,0);
}

import processing.video.*;

Capture video;

void setup() {

size(320,240);

video = new Capture(this,width,height);

video.start(); // you might not see this in older examples

}

void draw() {

// Capture and display the video

if (video.available()) {

video.read();

}

image(video,0,0);

}

Movie class

import processing.video.*;
Movie myMovie;

void setup() {
  size(200, 200);
  myMovie = new Movie(this, "myGreat.mov");
  myMovie.loop();
}

void draw() {
  tint(255, 20);
  image(myMovie, mouseX, mouseY);
}

// Called every time a new frame is available to read
void movieEvent(Movie m) {
  m.read();
}

import processing.video.*;

Movie myMovie;

void setup() {

size(200, 200);

myMovie = new Movie(this, "myGreat.mov");

myMovie.loop();

}

void draw() {

tint(255, 20);

image(myMovie, mouseX, mouseY);

}

// Called every time a new frame is available to read

void movieEvent(Movie m) {

m.read();

}

int r = red(video.pixels[55]);  //unpacks the red component of the 55th pixel
int g = green(video.pixels[55]); //unpacks the green component of the 55th pixel
int b = blue(video.pixels[55]); //unpacks the blue component of the 55th pixel
int b = brightness (video.pixels[55]); //unpacks the brightness of the 55th pixel
int h = hue(video.pixels[55]); //unpacks the hue of the 55th pixel
int s = saturation(video.pixels[55]); //unpacks the saturation of the 55th pixel

video.pixels[55] = color(255,0,255);  //pack a color with a lot of red and a lot of blue into the 55th pixel

int r = red(video.pixels[55]); //unpacks the red component of the 55th pixel

int g = green(video.pixels[55]); //unpacks the green component of the 55th pixel

int b = blue(video.pixels[55]); //unpacks the blue component of the 55th pixel

int b = brightness (video.pixels[55]); //unpacks the brightness of the 55th pixel

int h = hue(video.pixels[55]); //unpacks the hue of the 55th pixel

int s = saturation(video.pixels[55]); //unpacks the saturation of the 55th pixel

video.pixels[55] = color(255,0,255); //pack a color with a lot of red and a lot of blue into the 55th pixel

Comments Off on Images

Posted in Lateral Thinking with Withered Technology

moving on up

Posted on July 29, 2015 | Comments Off

objects
- class
- constructor
- (new tabs!)
arrays
- arrays plus for loops

// communication between objects (collison)
// distance between centers
// is dist < r1+r2

float d = dist(x, y, other.x, other.y);
if (d < r + other.r) {
return true;
} else {
return false;
}

// communication between objects (collison)

// distance between centers

// is dist < r1+r2

float d = dist(x, y, other.x, other.y);

if (d < r + other.r) {

return true;

} else {

return false;

}

code from class

// what's this do?

void keyPressed() {

if (key=='s' || key=='S') {
counter++;
saveFrame(counter+".png");
}
}

// what's this do?

void keyPressed() {

if (key=='s' || key=='S') {

counter++;

saveFrame(counter+".png");

}

Comments Off on moving on up

Posted in Class notes, Processing

Animation

Posted on July 23, 2015 | Comments Off

bouncing balls
random()
functions
- return type (int, float, void, etc)
- name
- arguments
while()
for()
- useful for many things, video, drawing, lists, etc.
~~objects?~~
~~arrays?~~
~~translate(), pushMatrix(), popMatrix()?~~

code from class

Comments Off on Animation

Posted in Class notes, Processing

Primitive Drawing

Posted on July 21, 2015 | Comments Off

Processing :: Setup//draw (just like loop())

size
width and height
background
coordinate system
line
point
ellipse (ellipseMode)
stroke/nostroke/fill/nofill
rect (rectMode)
mouseX mouseY

code from class

Comments Off on Primitive Drawing

Posted in Class notes, Lateral Thinking with Withered Technology, Processing

Some notes on your RGB LEDs

Posted on July 17, 2015 | Comments Off

So we didn’t get the chance to do color mixing with the LEDs, but I hope you all try it out. Here’s some notes on them….

Continue reading →

Comments Off on Some notes on your RGB LEDs

Posted in Arduino, Class notes

Tricking the machines

Posted on July 16, 2015 | Comments Off

So far, we’ve managed to get the micro controller to read digital & analog inputs, ad set a variety of fancy LED effects. Now it’s time to make some even more fancy things happen.

The microcontroller has the ability to red variable voltages, but what about sending out a variable voltage? Unfortunately, unless we’re using a high end microcontroller with a built in DAC (digital to analog converter), there’s no way to get a true analog voltage out of the microcontroller. However, we can fake it with a technique called Pulse Width Modification (PWM).

Continue reading →

Comments Off on Tricking the machines

Posted in Arduino, Class notes

Author Archives: Scott

Draw a line based on a color in a video

Swap out a color with another one in a video

I’ve got no strings

Putting it all together

Images

moving on up

Animation

Primitive Drawing

Some notes on your RGB LEDs

Tricking the machines

Recent Posts

Recent Comments

Archives

Categories

Meta