That’s an interesting idea, with respect to having the lights tie into the video palette. If I were going to tackle that, I would probably start with Max/MSP’s Jitter objects to work with the video stream, if you have it available (and it sounded as though you might?) just because it’s designed for exactly that sort of tinkering. Then when you can identify a palette (and perhaps vague spatial relationships), yeah, turn it into some blooms or something. Another place you might want to look for inspiration in this regard, outside of Max, would be some of those open-source kits that use Raspberry Pi to create a palette of LED lights behind a television set which tie into the scene being displayed. There is probably some great code you could borrow from that.