26th November, 2024. Congratulations to lab member Jemily Rime, whose paper “Interviewing ChatGPT-generated personas to inform design decisions” won best paper award at the Interational Conference on Computer-Human Interaction Research and Applications (CHIRA).
6th November, 2024. Back to a POTUS who knows their windmills.
10th November, 2024. The International Society for Music Information Retrieval (ISMIR) Conference is taking place November 10–14 in San Francisco.
The lab has two papers at the conference this year:
5th October, 2024. We opened the 2024 AI Song Contest at Innovation Park Zürich with a live performance of our song called “Heart not found” by Error 305.
This lab works on basic science – development and testing of artificial intelligence for music analysis and generation – through to studies of application and societal impact – artist collaborations and contests such as this. Our $100K Concerts with Humans and Artificial Intelligence (CHAI) project, funded by U-LINK at University of Miami, is supporting a lot of this applied work.
9th May, 2024. The following research projects have just got underway or are starting next month. Follow the links to read more about them!
11th April, 2024. Tom was at the Frost Science Museum on Thursday evening for FilmGate Fusion, presenting the VR version (best experienced with a Meta Quest) of VTGO (Vertigo).
Videography by Mariana Medina
31th January, 2024. The AI Summit of the Americas is taking place at University of Miami on Tue 13th Feb, 2024, and features eminent contributors such as Nevenka Dimitrova, Matt Serletic, and Tom Griffiths. Find out more and register here.
There is also a hackathon taking place all day Sat 10th Feb with generous cash prizes!
29th November, 2023. VTGO (Vertigo), a collaboration with Kemi Sulola and Harriet Raynor, is out today! See here to listen to it on your platform of choice.
We're proud to say the song finished 3rd in the 2023 AI Song Contest!
19th July, 2023. Lab members Chenyu Gao and Tom Collins are presenting at the HCI International Conference and the associated Workshop on Interactive Technologies for Analysing and Visualising Musical Structure in Copenhagen, beginning Sunday 23rd July.
Chenyu's contribution is about interactive pendular graphs, which can be explored here.
18th July, 2023. Lab PhD student
Adrián Barahona-Ríos
has been working on sound effect modelling and synthesis. The new
model, indicated in the diagram above and called
NoiseBandNet,
has some exciting creative applications. For example, once trained on a
sound like this metal impact:
we can drive the timbral world of metal impact with the loudness
curve extracted from another sound, such as this beat box clip:
resulting in an interesting hybrid:
In addition to the music-creative possibilities indicated above, we anticipate applications in game audio and XR, where until now it has been labour-intensive to generate scene-driven alterations to sound effects.
14th April, 2023. Congratulations to former lab member Zongyu Yin, who has won the Computer Science Dept.'s Best PhD Thesis Prize for 2022, for his work New evaluation methods for automatic music generation.
10th April, 2020. "It's doing what I hoped it would do, which is what I believe AI will do for musicians, which is to push us to the next level of our own creativity" (Imogen Heap, Grammy Award-winning musican and technologist on working with music generation algorithms built in the lab).
12 April, 2021. Here are some fun, educational interfaces for kids to explore music technology. We have found some of these interfaces engage kids as young as two years old. For kids aged four and above, up to you whether to explore side-by-side with them, or say farewell to your device and let them have at it...
Learning JavaScript is a good place to start. I've put some demos below to get you excited about wanting to do this! Read more...
Here are some examples of dynamic web-based music interfaces that have been developed in the lab, using packages built on the Web Audio API. For pedagogical purposes, we have used mostly basic JavaScript, left comments in the code, and avoided optimizations like minifying. If you make JSFiddles, CodePens, or your own standalone interfaces based directly or indirectly on what you find below, please feel free to share them with us to enhance the pedagogical experience!
To rework/extend the demos, you'll need to understand how to program in HTML, CSS, JavaScript, PHP, and Node.js, with the most important of these being JavaScript. Read more...
In the interests of closing the gender pay gap, my salary as an Associate Professor at a private institution is $120K.
We like hearing from people who are interested in contributing to the work of the lab. At the moment, we're particularly interested in hearing from people with software engineering expertise who are looking for more autonomy and to learn some research skills.
Feel free to get in touch if you fit any of the categories below.
Familiarity with Node.js and SQLite or another database solution. Experience with client-side syntax/library such as Handlebars, React, or Vue. Ideal candidate has experience with building single-page web applications from API to UI/X with authorization and access control.
First-author publications and/or evidence of writing productivity appropriate to level. Experience as a music scholar, a computer scientist, a cognitive scientist, or some combination of the three. Demonstration of willingness to work on and optimize time-consuming tasks such as data collection and analysis, and music data curation.
Interest in music, computer science, cognitive science, or some combination of the three. Has looked at the demos and attempted to rework/extend at least one of them.
Both in the lab and with collaborators across the globe, we apply the scientific method to explore...
This is a team of researchers that we hope will grow in exciting ways over the next decades – even beyond the current PI's retirement! If you are interested in working with us, you are welcome to get in touch to discuss opportunities. We're happy to try to support face-to-face research visits and/or distributed collaborations.
Here's the team, present and past, in pseudo-random order...
I hope you enjoyed visiting this site.
Feel free to get in touch (tom.collins@miami.edu) if you have any
questions or suggestions.
The code above was written by Tom Collins and others as specified (e.g., toward the bottom of each demo interface). Reuse of the code is welcomed, and governed by the GNU General Public License Version 3 or later.