Hey Kate I don't have any explicit ideas at the moment but will think on it - such a cool concept! I wonder if there's some form of tactile spectrogram that you could develop, or a way that you could have them try to draw a representation (so assign some shape) of what they are hearing as a means of classification a call and then clustering those shapes? There's a way of creating an image using foam and paper I believe so they could have a tactile record of those shapes. Guess it depends what you want to the quantitative results to be. Super cool that you are looking for greater accessibility in acoustics!!!

Hi Kate, 

We've developed a screen-reader workflow for a classification problem on our "Ocean Voices" Zooniverse project, which simply asks folks to label sounds based on what they hear and omits the spectrogram altogether. There are lots of screen-reader users who are active in the Zooniverse Talk forums, so they may have valuable input for you as well. 

Once a person has labeled data, I wonder if they could run automated detectors over the data in Pamguard, calculate features (using something like the R package PAMpal), and then use the BrailleR package to explore the statistics in R. This article has a pretty interesting summary about statistical software for visually impaired folks - might not be news to your student, but I thought it was pretty cool. 

I'm very curious what our friends who are visually impaired might notice in the acoustic data. Best of luck to you and your student! 

Cheers, 

Anne 

Hi Kate- ARISTA Lab (Advanced Research in Inclusion & STEAM Accessibility) is actively working on this through their eclispse soundscape project. I recommend reaching out to MaryKay to get the latest on their project.  

Megan

Super initiative! I hope you get a lot of entries to this coding challenge!

Not sure if audio data would be of any use to you, but if so FishSounds has some - I just tried their search function and there is a location tag for 'Mediterranean & Black Sea'. 

You might try reaching out to the folks at Name that Fish, Innovasea, or perhaps an entity on the Fisheries Tech list would have Mediterranean stuff? 

Hi,

If this is still relevant, you can try reaching out to the Belmaker lab, they do BRUV surveys in the eastern Mediterranean and have hours of video, some of it I believe is annotated. Particularly, Shahar might be helpful, he's the PhD student running point on the project.

We have made available our underwater videos on YouTube as a playlist https://www.youtube.com/playlist?list=PLnhVZKKy8WkZKriCIV6r7upWhHNVrU_7L 

It's about 1.113 short video clips with annotation and each is linked to the corresponding www.iNaturalist.org observations. The iNaturalist.org observations are research quality and have been uploaded to GBIF.org. The observations have been made between 2014 and 2022 around the Ionian Islands (Greece).

If you would need the original videos please contact me.

I'd be happy to chat with you if you wanted! My expertise is within passive acoustic monitoring particularly. The Conservation Tech Directory might be useful for you in identifying relevant actors within the space.

Happy to contribute tgray@woodsholegroup.com 

My original background is in ecology and conservation, and am now in the elected leadership of the Gathering for Open Science Hardware which convenes researchers developing open source tech for science. I am not working on a specific piece of technology right now, but am happy to contribute some higher-level views for your interview if that helps.