After seeing VidPy's "chroma" feature I knew I wanted to experiment with overlaps and color masks. This project took several detours as I tried exploring a few approaches and turned into an exercise (rather lesson) of thinking before doing.
I first played around with openCV with the mindset that portraits would open some interesting avenues. i was excited to combine K Nearest Neighbor with OpenCV (where each face would be a point of interest) and have the chroma effects tied to each person. Sure enough simply figuring out numpy arrays was challenging enough and I settled on manually creating a chroma effect by reading and manipulating the pixels values of a video.
I decided to tie the rewriting of pixel values with the volume of the audio from a music video. In each music video, the volume at any frame affects the amount of pixel information is masked in red. In a separate script, using VidPy's chroma feature, I then removed those masked areas and combined multiple videos in hopes there would be a push and pull between the videos as they fight over space. It ws an interesting experiment, but the resulting video falls flat.