Monthly Archives: August 2015

Hi All,

This was by far one of the most frustrating things that I have ever done.  I was a situation of knowing what the computer had to do in English, but completely over complicating it and forgetting simple stuff when coding. (Ex. “Serial.begin(9600)”) Dumb. Not having power plugged in.  Dumb.  In the end, with a serious amount of help from Scott, it worked.

There are a whole bunch of next steps.  I think the visual feedback is really important as a guide. Like the glove I made, the LED tells you which scale you a playing.  Creating a trellis like board that would support the 4 pronged through hole NeoPixels seems like a lot of work and skills that I don’t have, but Mike’s arcade buttons inspired me.  An arcade button MIDI controller with customizable LED colors.  Get a microSD card reader and a speaker in there. Awesome. Get some bluetooth or other wireless protocol and have two of them talking to each other. Awesome.  So many ideas.

Anyway, here is the video:

Here’s the Arduino Code:

Here’s the processing code:

Thank you all for such an awesome class. I had a bitchin’ time.

🙂

IMG_4901

Thanks for everything guys

I’m very inspired by the website called “We feel fine.”

It is a website that collects people’s posts about feelings from the internet. I want to do a physical mood display. Different color pastels represent different moods. User can pick up the color that stands for current feeling, and use it as a brush to write or draw anything on the screen. After that, users can also take a photo with what they write or draw and save it for keeping or sharing later:)

MoodDisplayBoard_480p

The complete code:

Arduino:

int potVal;

void setup() {
// put your setup code here, to run once:
Serial.begin(9600);
}

void loop() {
// put your main code here, to run repeatedly:
potVal = analogRead(A0);
Serial.println(potVal);
delay(2);
}

Processing:

// Smoother color tracking
// based on Dan Shiffman & Dan O’Sullivan’s examples

import processing.video.*;

// Variable for capture device
Capture video;

PGraphics drawing; /// a contect to hold the “drawing”
PImage vidMirror;

import processing.serial.*;
Serial mySerial;
float diam;

// A variables for the color we are searching for.
color trackColor;
float thresh = 20;
int avgX, avgY; //this is what we are trying to find
int prevAvgX, prevAvgY;

void setup() {
size(1280, 720);
video = new Capture(this, width, height);
video.start();
// Start off tracking for red
trackColor = color(255, 0, 0);

// instance of the drawing
drawing = createGraphics(width, height);

vidMirror = new PImage(video.width, video.height);

println(Serial.list());
// Print out the list and look for port your Microcontroller is on
// Finding the Arduino is not easy because they have weird names like “/dev/tty.usbmodem1421″ or COM1
String portName = Serial.list()[2];
mySerial = new Serial(this, portName, 9600);

mySerial.readStringUntil(‘\n’);
}

void draw() {
// Capture and display the video
if (video.available()) {
video.read();
}
video.loadPixels();
// image(video, 0, 0);

for(int x = 0; x < video.width; x++){
for(int y = 0; y < video.height; y++){
vidMirror.pixels[x+y*video.width] = video.pixels[(video.width-(x+1))+y*video.width];
}
}

vidMirror.updatePixels();
image(vidMirror,0,0);

//we are going to find the average location of changed pixels so
//we will need the sum of all the x find, the sum of all the y
// find and the total finds
int totalFoundPixels= 0;
int sumX = 0;
int sumY = 0;

// Begin loop to walk through every pixel
for (int x = 0; x < vidMirror.width; x ++ ) {
for (int y = 0; y < vidMirror.height; y ++ ) {
int loc = x + y*vidMirror.width;
// What is current color
color currentColor = vidMirror.pixels[loc];
float r1 = red(currentColor);
float g1 = green(currentColor);
float b1 = blue(currentColor);

// colors we are looking for
float r2 = red(trackColor);
float g2 = green(trackColor);
float b2 = blue(trackColor);

// Using euclidean distance to compare colors
float difference = dist(r1, g1, b1, r2, g2, b2);
// We are using the dist( ) function to compare the current
// color with the color we are tracking.

// If current color is more similar to tracked color than
// closest color, save current location and current difference
if (difference < thresh) {
sumX = sumX + x;
sumY= sumY + y;
totalFoundPixels++;
}
}
}

// average the locations of all the pixels that were close enough.
if (totalFoundPixels > 0) {
avgX = sumX/totalFoundPixels;
avgY = sumY/totalFoundPixels;
// Draw a circle at the tracked pixel
fill(trackColor);
strokeWeight(3.0);
stroke(0, 127);
ellipse(avgX-10, (avgY-10), 20, 20);
}

drawing.beginDraw();
drawing.stroke(trackColor);
drawing.strokeWeight(diam);
drawing.line(prevAvgX, prevAvgY, avgX, avgY);
drawing.endDraw();
blend(drawing, 0, 0, width, height, 0, 0, width, height, ADD);

prevAvgX = avgX;
prevAvgY = avgY;
}
void serialEvent(Serial _port){
if (mySerial == null) return; //this is a hack to cover a bug where the port does not get set up in time.
//this says if the port is not set up yet, bail (for now.)
String input = mySerial.readStringUntil(‘\n’);
if (input != null) { //if a ‘\n’ character has in fact now arrived
input = input.trim(); //Take off the ‘\n’ character, get rid off the white space
diam = float(input); //Turn it into number
println(diam);
}
}

void mousePressed() {
// Save color where the mouse is clicked in trackColor variable
int loc = mouseX + mouseY*vidMirror.width;
trackColor = vidMirror.pixels[loc];
}

void keyPressed() {
//for adjusting things on the fly
if (key == ‘q’){
video.stop();
save(int(random(10))+”.jpg”);
}

if (key == ‘[‘) {
thresh–;
println(“Threshold ” + thresh);
} else if (key == ‘]’) {
thresh++;
println(“Threshold ” + thresh);
}
}

Hi again,

It was wonderful to meet and learn from all of you,  and also thank you Scott for being a fantastic professor. I hope we all stay in touch, or that in the future I see all of your work advertised on billboards all over the city (ideally, both scenarios). Best of luck to you all in the coming semester and forward.

Here is the link to my final:

courtneypozzi.com/focus

Thanks guys!

Hi all,

Here is assignment of combining an existing processing sketch with arduino controls. I believe I showed it in class (maybe over the break?) but now it can also live permanently on the site.

physical_pong

Here is Version 3 of my Slide Show algorithm!

This Program works simply by using one of the two slide potentiometers to control the picture on screen as well as the music in the background. The volume level of the sample just called as well as the volume level of the background music can be controlled.

It’s the prototype for an Art Installation that requires user participation to “mix” the music with these selectable fragments/

Problems: Overall it was not too challenging getting everything working, the only hurdle encountered was truly getting a grasp for how the serial commands work. The handshake between the serial port and processing can be tricky which is why a number of lines of code are needed to make sure the data streams are lined up properly. I was accidently streaming data in before the system was ready to accept any data, that lead to a number of issues that were cleanly resolved with a if statement that checked if the data stream was truly ready to be read in.

In regards to the program I will hit some of the highlight functions. I built a custom class duoPA that was able to load in the music files as well as the pictures and pair them together. So whenever my sample selector would select a point it would be referencing two files. Also have a pixel scrambler running in the background as well as a function that randomly selects sections of a loaded in picture and throw it into the main screen. Everything is controlled by millis() and modulo division looking for zero for timing.

It was a ton of fun getting this all working and I can’t wait to ship out v4!

-JS