Group

Data management and processing tools / Feed

Conservation tech work doesn't stop after data is collected in the field. Equally as important to success is navigating data management and processing tools. For the many community members who deal with enormous datasets, this group will be an invaluable resource to trade advice, discuss workflows and tools, and share what works for you.

discussion

Automatic extraction of temperature/moon phase from camera trap video

Hey everyone, I'm currently trying to automate the annotation process for some camera trap videos by extracting metadata from the files (mp4 format). I've been tasked to try...

10 1

I just noticed that TrapTagger has integrated AI reading of timestamps for videos. I haven't had a chance to try it out yet, but it sounds promising. 

Small update. I uploaded >1000 videos from a spypoint flex camera and TrapTagger worked really well. Another program that I'm currently interested in is Timelapse which uses the file creation date/time. I haven't yet tried it, but it looks promising as well. 

Hi Lucy,



I now realised it is an old thread and you most likely have already found a solution long ago but this might be of interest to others.

As mentioned previously, it is definitely much better to take moon phase from the date and location. While moon phase in general is not a good proxy for illumination, that moon phase symbol on the video is even worse as it generalises the moon cycle into a few discreet categories. For calculating moon phase you can use suncalc package in R but if you want a deeper look and more detailed proxy for moonlight intensity, I wrote a paper on it 

 with accompanying R package called moonlit 

When it comes to temperature I also agree that what is recorded in the camera is often very inconsistent so unless you have multiple cameras to average your measurements you are probably better off using something like NCEP/NCAR Reanalysis (again, there is an R package for that) but if you insist on extracting temperature from the picture, I tried it using tesseract and wrote a description here: 

 

Good luck!

See full post
discussion

How do you fund or finance your long-term data infrastructure?

Today at the Bioacoustics Data Networks and Platforms webinar during the after hour, there was a great discussion about long term data infrastructure. Not just how to...

6 2

Hej @kimhendrikse,

Not really the kind of answer I was looking for ( because we now still don't know how you finance your setup ), but it is an interesting answer to the question which is also practiced here and there. But the financing problem will not disappear. It will just be distributed as well. The nodes still need funding. Less so per node, which might make it a lot easier, but there is still funding involved. Perhaps there is even a way to distribute the 'central' catalogue. I wouldn't insert a central repositoring chaching data because then we're back at something big and expensive again. 

Also, there will be costs involved in developing and maintaining standards, which also need to be paid - through membership fees perhaps. Lastly one would need a way to deal with those nodes that cannot fund themselves anymore. It would lead to fewer and bigger nodes and should not happen too much because then we're back at square one.

 

"because we now still don't know how you finance your setup"

I pay for everything myself out of the salary from my full time job :-(

But... long term I'm seeing a future in starting a company that sells products. (Maybe not that long term).

That's a really honest answer Kim! Thank you for clarifying

You're likely not the only one. In fact it would be interesting to find out how much conservation tech use and development is funded through personal means. I made a note. Perhaps we'll do a poll sometime

See full post
event

Design-led innovation for nature

How can space-enabled data and services be translated into information that is trusted and actionable, fuelling responsible behaviours towards nature? A new programme where SMEs will be paired with design consultancies...

0
See full post
discussion

efficient methods for labeling clusters of fish in images for segmentation purposes 

Hi everyone,Our team is working on a project involving the segmentation of individual fish within clusters (groupers specifically). We have images with hundreds of groupers...

2 0

hi, if your intention is to use programming and a programming language like Python then one option which can give good results is the SAM (Segment Anything) or SAM-2 algorithm. The following weblinks include more information:

 

Agreed. I have recently begun using SegmentAnything as a replacement for Detectron and have been very pleased. However, for a fish school I don't know how well it would do out of the box with the many overlapping fish. 

See full post
discussion

Rapid Camera Trap labeling with ChatGPT

Hi all, I've published a blog post on rapidly labeling camera trap data using ChatGPT for species identification and a simple object detection model to get the bounding boxes....

3 6

super interesting, thank you for sharing! definitely will watch!

Really interesting, I will take a look

See full post
discussion

WILDLABS AWARDS 2024 - Mobilizing Motus: optimizing a wildlife tracking data pipeline for aninternational, collaborative conservation technology community

We’re delighted to introduce our project, Mobilizing Motus. Motus, a Latin word for movement, is a collaborative wildlife tracking system that uses automated radio telemetry...

2 4
See full post
discussion

Simple Data Standards for wildlife reserve management scenarios?

Hi - I've been lurking on Wildlabs for a while, consuming as much info as humanly possible, but I seem to miss specific info for my current needs.I'm the self appointed in house...

2 1

Just as a note, you might also be interested in specific protected area management software like SMART or EarthRanger as well!

Thanks!

I'm definitely looking at Smart and EarthRanger for overall management eventually, but for now I just want to track what we have better - especially as a base map to support further advanced management activities. Funding and available human resources to effectively manage a tech based scientific and best practice focused solution is in short supply - but will hopefully be better addressed within the next year or two. 

 

See full post
discussion

Auto ID Software for NA Amphibians?

Hi All!So I'm currently running 4 Wildlife Acoustic Song Meter MiniBats at my beaver research and control sites as a means to measure species richness. 2 units at each site, one...

2 0

Hi Cortney,

I recommend exploring the tools developed by Kitzes Lab, such as OpenSoundscape, which can be used for the automatic detection of anurans. Here's a reference paper that might be useful. You might also consider reaching out directly to Justin Kitzes @jkitzes  for more specialized advice.
Also here is a another paper that use BirdNet to automatically detect the bullfrog presence.
Best of luck with your analyses!

Retweet on OpenSoundscape - great package and documentation that allows you to build your own CNNs! Note that this is in Python though. 

There are tons of bioacoustics software and packages in @tessa_rhinehart 's helpful list too! Some more recent options that I don't think are on that yet are Whombat and gibbonNetR (which uses the 'Torch for R' ecosystem). 

Also, Raven has template- and energy-based detectors you could try as well. The monitoR and warbleR packages allow you to do template-based detections too. BirdNET is integrated into Raven now as well.

You can also try Kaleidoscope's native clustering function.

Agree with you that there's definitely not enough resources for frog detection though! I'm assuming the Australian one you found is FrogID? There is also AnuraSet, but this is for neotropical frogs.  

See full post
discussion

Move BON Development: Follow up discussion

Hey Biologging Community! We just launched a new initiative to mobilize animal tracking data in support of national and global scale conservation goals (learn more here!). If you...

6 6

Hi Talia! 

I feel like the topic is so broad that it might help to put some constraints around things, see what works, and then broaden those out. I have a lot of ideas regarding the data monitoring and collection side based on the other sensor and observation networks we've set up in the past. 

There may also be some potential scope to incorporate things like data collection and integrated monitoring to the Build Your Own Datalogger series where the system is updated to feed data into the observation network. 

It'd probably take a bit of discussion and coordination. Let me know if interested. I'm fine to jump on a call or discuss via email too.

@cmwainaina please take a look

See full post
discussion

Looking for literature materials/any useful data on HHC(Human-Hippopotamus Conflict) mitigation and coexistence.

Hello Wildlabbers,I am looking for anyone who have done some research on human-hippopotamus conflict mitigation and coexistence or anyone who might have some scientific info/...

8 7

Hi loveness,

Your doing great here are some research that may be helpful on what your looking for

search for article of Human-Hippopotamus Conflict: Impacts and Mitigation Strategies published in the Journal of Wildlife Management.

https://www.google.com/search?client=ubuntu-sn&sca_esv=23430e1df8f38b82&channel=fs&q=Assessing+Human-Wildlife+Conflict+with+Hippopotamuses+in+the+Context+of+Wildlife+Conservation+from+the+African+Journal+of+Ecology.&sa=X&ved=2ahUKEwigkNqHx5SHAxXi0gIHHaOBA-EQgwN6BAgFEAE

 

 

See full post
Link

Rapid Camera Trap labeling with ChatGPT

Hi all, I've published a blog post on rapidly labeling camera trap data using ChatGPT for species identification and a simple object detection model to get the bounding boxes. While presented in Edge Impulse, this approach can be replicated outside the platform using Python...

1
careers

Data Manager, Conservation International

Conservation International are seeking a data expert to help (a) serve as a day-to-day technical project manager to ensure data collection, data management, and data quality control with global program teams and...

2
See full post
Link

EarthRanger: How high-tech tracking is keeping tabs on wildlife | CNN

EarthRanger use in Northern Kenya's Sera Conservancy by veterinarians to track and monitor rhinos.

2
discussion

Question About Interpolation

Hello! I am a Computer Science Student experimenting with the multi-step models on TensorFlow's "Time series forecasting" tutorial.I am applying to the models the positional data...

1 0

The use of synthetic training data such as interpolated sequence values is common, but fraught with the issue of your synthetic signal generating features that are not true to real life. 

Instead, you might think about about appending the values of two long-period sin waves per input element to the sequence going in to your first linear / fully-connected layer. The simplest thing that could possibly work would be to interpret minute of the day and day of the month as the values of your sin wave! (Or perhaps minute/hour if all training sequences are quite short.) Since you’re doing sequence prediction, you would add the appropriate values for each image(?) in the sequence being evaluated.   

With that additional signal going in to the model in the early layers, the NN should have a good chance of learning that the differences in the modulating signal corresponds to distance in time. 

This technigue was popularized by early Large Language Models to encode the distance between words. There’s been refinement (search “Rotary Encoding” for instance) but the basic idea of sin waves generalizes well.

See full post
discussion

'recurse' R package help

Hi all!  I am researching the spatio-temporal movements of reintroduced eagles, using the recurse package in R Software (developed by Bracis et al. - using the bird 'Leo...

1
See full post
article

NEW PUBLICATION ALERT!

One of the most thrilling moments for any researcher is seeing their hard work published for the world to see. As part of the Women in Conservation Technology (WiCT) Kenya Cohort One, we not only learnt about the use of...

2 4
Congratulations Consolata!!! So exciting to read this :)
Many congratulation Consolata for such a milestone.
See full post