Hello,
We did a surprising amount of musical projects, like this one (https://www.youtube.com/watch?v=he5iY_X-E5U—the video is out of sync often, but it played nicely and in real-time), and also performative projects (e.g., the one Karl posted at https://www.youtube.com/watch?v=C0kUZhFH4hc).
But unfortunately, there is no easy solution; for the e-guitar project, we developed a kind of custom notation system that allowed a non-programmer to time and fine-tune the sound in Grasshopper (followed by a lot of trial and error to get the timing right, but GH nicely supported such an iterative process). On the KUKA side there is a system for time-based programming called ready2animate, but it also has got its limitations and won't help you on an ABB robot.
For that performance (https://creativerobotics.at/underbody/), we used RSI (hard-realtime control on KUKA robots, i.e. one position every 4ms) to map the movement in real-time to the robots. I assume that ABB has a similar system. But hard-realtime can be a pain to deal with.
Hopefully, these pointers will also be useful for an ABB-based application.
Best,
Johannes
We did a surprising amount of musical projects, like this one (https://www.youtube.com/watch?v=he5iY_X-E5U—the video is out of sync often, but it played nicely and in real-time), and also performative projects (e.g., the one Karl posted at https://www.youtube.com/watch?v=C0kUZhFH4hc).
But unfortunately, there is no easy solution; for the e-guitar project, we developed a kind of custom notation system that allowed a non-programmer to time and fine-tune the sound in Grasshopper (followed by a lot of trial and error to get the timing right, but GH nicely supported such an iterative process). On the KUKA side there is a system for time-based programming called ready2animate, but it also has got its limitations and won't help you on an ABB robot.
For that performance (https://creativerobotics.at/underbody/), we used RSI (hard-realtime control on KUKA robots, i.e. one position every 4ms) to map the movement in real-time to the robots. I assume that ABB has a similar system. But hard-realtime can be a pain to deal with.
Hopefully, these pointers will also be useful for an ABB-based application.
Best,
Johannes