Powerful conservation tech tools are gathering more data in the field than ever before. But without equally powerful and effective data management and processing tools, that data - no matter how groundbreaking or interesting - will not be able to reach its full potential for impact.
Data management can sometimes seem intimidating to conservationists, especially those just getting started in the world of conservation tech or experimenting with new data collection methods. While every community member's workflow and preferred data management and processing methods may be different, this group can serve as a resource to explore what works for others, share your own advice, and develop new strategies together.
Below are a few WILDLABS events dealing with datasets collected from various conservation tech tools:
Nicole Flores: How do I get started with Wildlife Insights?
Jamie Macaulay: How do I analyse large acoustic datasets using PAMGuard?
Sarah Davidson: Tools for Bio-logging Data in Conservation
Whatever conservation tech tools you work with, and whatever your preferred data management methods, we hope you'll find something helpful and effective in this group when you become a member!
WILDLABS & Wildlife Conservation Society (WCS)
I hold a PhD in Biological Sciences and specialize in bioacoustics and passive acoustic monitoring of cetaceans in the Argentine Sea and Antarctica. Recently, I've also embraced computing to leverage technology in enhancing our conservation efforts.
- 7 Resources
- 2 Discussions
- 14 Groups
- @Brickles
- | He/Him
- 0 Resources
- 0 Discussions
- 7 Groups
Sustainability Manager for CERES Tag LTD. An animal health company; animal monitoring, conservation, & anti-poaching/ rural crime. Wildlife, livestock, equine & companion. #CeresTrace #CeresWild #CeresRanch
- 2 Resources
- 19 Discussions
- 24 Groups
Interested in EvoDevo, Bioinformatics, Genomes and Conservations Tools. Your contact for SequenceServer. https://sequenceserver.com/
- 0 Resources
- 1 Discussions
- 5 Groups
Wildlife Drones
Wildlife Drones has developed the world’s most innovative radio animal-tracking system using drones so you can track your radio-tagged animals like never before.
- 11 Resources
- 8 Discussions
- 32 Groups
- @Kavutha
- | Her/She
- 0 Resources
- 1 Discussions
- 7 Groups
- 0 Resources
- 0 Discussions
- 3 Groups
- @jcaris
- | hi/him
Smith College & Cummings School of Veterinary Medicine at Tufts University
Senior Drone Data Scientist, Tufts University; Former Director of the Spatial Analysis Lab at Smith College. Teaching, learning, and collaborating with brilliant students & faculty
- 0 Resources
- 0 Discussions
- 9 Groups
- @crazybirdguy
- | Him
Field Biologist at Yayasan Cikananga Konservasi Terpadu, Indonesia, with experience and interest mainly in ornithology, citizen science and bioaccoustic
- 0 Resources
- 6 Discussions
- 12 Groups
- @ahmedjunaid
- | He/His
Zoologist, Ecologist, Conservation Biologist
- 0 Resources
- 0 Discussions
- 16 Groups
- @stefan_istrate
- | he/him
Machine Learning Researcher & Nature Photographer. Building conservation tech for biodiversity monitoring at Wildlife Insights.
- 0 Resources
- 2 Discussions
- 9 Groups
- 0 Resources
- 0 Discussions
- 17 Groups
Article
SMART is excited to showcase the features of their new data collection solution, SMART Mobile! Built around the specific needs of the SMART user community, this streamlined mobile tool allows staff in protected areas to...
23 June 2020
A couple months ago, we introduced you to the Footprint Identification Technique (FIT), a non-invasive way to build an identification algorithm from both wild and captive animals by photographing footprints. Today, we'...
3 June 2020
Article
How does tracking technology meet the many challenges specific to monitoring birds within their home ranges and over long distances during migration? WILDLABS community member Virginie Perilhon from Xerius Tracking...
23 April 2020
The Esri Conservation Program is now accepting applications for grant assistance to access its ArcGIS Solutions for Protected Area Management Application. This system provides access to a suite of both mobile and web...
4 March 2020
Are you ready for the Plastic Data Challenge? This global contest wants your innovative ideas for improving the plastic waste management and recycling chain in South and Southeast Asia. Participants can consider...
3 March 2020
Tom Swinfield and colleagues at the Forest Ecology and Conservation Group have assessed the quality of three dimensional forest models produced from drone surveys, and conclude that concerns about their quality for...
31 May 2019
Ted Schmitt joined us for a lunchtime lecture in which he shared his experiences working across Africa the past five years with protected area managers, anti-trafficking organisations, and scientists to effectively...
22 November 2018
Funding
The European Space Agency is calling for Kick-Start ideas to leverage space technology for wildlife protection. Three main topics of interest have been identified: 1) Wildlife monitoring, tracking and inventory, 2)...
5 July 2017
The Conservation Leadership Programme (CLP) is a training and capacity building programme that targets individuals from developing countries who are early in their conservation career and demonstrate leadership...
21 November 2016
Do you work on conserving Neotropical migratory birds? Do you need funding? Why not apply for a grant from the U.S. Fish and Wildlife Service through the Neotropical Migratory Bird Conservation Act's grant program? The...
8 November 2016
Operating the largest tropical forest camera trap network globally, TEAM Network has accumulated over 2.6 million images. How can large datasets coupled with new techniques for data management and analysis provide...
28 April 2016
From artificial “sniffer” technologies to portable DNA sequencers, the Wildlife Crime Tech Challenge received hundreds of innovative ideas to help stamp out wildlife crime. Now, the Challenge is proud to announce 16...
22 January 2016
June 2024
July 2024
October 2024
April 2024
event
March 2024
event
70 Products
Recently updated products
Description | Activity | Replies | Groups | Updated |
---|---|---|---|---|
Hello WILDLABS Community!I work on the development of the hardware for networks of fixed radio receivers that are used to detect... |
|
Data management and processing tools | 4 months 1 week ago | |
Hi!I would take a look at Although developed for camera trap imagery, it is by no means restricted to such.Cheers,Lars |
|
Camera Traps, Community Base, Data management and processing tools, Drones, Emerging Tech, Remote Sensing & GIS, Software and Mobile Apps | 4 months 1 week ago | |
Fire detection is a sort of broad idea. Usually people detect the products of fire, and most often this is smoke.Many home fire detectors in the US use a radioactive source... |
|
Community Base, Conservation Tech Training and Education, Data management and processing tools, Ethics of Conservation Tech, Human-Wildlife Conflict, Open Source Solutions, Protected Area Management Tools, Sensors, Wildlife Crime | 4 months 2 weeks ago | |
I'm also here for this. This is my first comment... I've been lurking for a while.I have 20 years of professional knowledge in design, with the bulk of that being software design... |
|
AI for Conservation, Camera Traps, Data management and processing tools, Software and Mobile Apps | 4 months 3 weeks ago | |
Perfect. Looking forward to hearing from you! |
|
Data management and processing tools | 4 months 3 weeks ago | |
Hi folks! Happy 2024 and thanks in advance for your patience in case I over-used tags. If you’re using any form of natural language... |
|
AI for Conservation, Citizen Science, Climate Change, Conservation Tech Training and Education, Data management and processing tools, Early Career, East Africa Community, Emerging Tech, Ending Wildlife Trafficking Online, Ethics of Conservation Tech, Human-Wildlife Conflict, Open Source Solutions, Software and Mobile Apps, Wildlife Crime, Women in Conservation Tech Programme (WiCT) | 4 months 4 weeks ago | |
camtrapR has a function that does what you want. i have not used it myself but it seems straightforward to use and it can run across directories of images:https://jniedballa.... |
+2
|
Camera Traps, Data management and processing tools, Open Source Solutions, Software and Mobile Apps | 6 months ago | |
Hi @GermanFore ,I work with the BearID Project on individual identification of brown bears from faces. More recently we worked on face detection across all bear species and ran... |
|
AI for Conservation, Camera Traps, Data management and processing tools, Software and Mobile Apps | 7 months ago | |
Stefano Puliti joined Variety Hour to share his work using 3D photogrammetric data from UAVs for pre- and post-harvest inventory of forest... |
|
Climate Change, Data management and processing tools, Drones, Remote Sensing & GIS | 8 months ago | |
We use Kobo as well - it is amazing!!! |
+6
|
Data management and processing tools, Software and Mobile Apps | 8 months 2 weeks ago | |
'Gundi, meaning “glue” in Swahili, is a technology platform that allows conservationists to seamlessly integrate any hardware with any... |
|
Data management and processing tools, Sensors, Software and Mobile Apps | 8 months 3 weeks ago | |
I wish to share an update on my MSc thesis project, that contributes to the field of decoding animal communication. In my work I... |
|
Acoustics, Data management and processing tools, Early Career | 8 months 4 weeks ago |
movedesign: Shiny R app to evaluate sampling design for animal movement studies
13 March 2024 3:10pm
This "workflow allows users to evaluate a wide range of potential sampling designs, which can then serve as a solid foundation for future tracking projects, or even the evaluation of on-going and published studies."
Biodiversity Informatics Innovations using MindMaps
13 March 2024 6:32am
Navigating corporate due diligence in the Voluntary Carbon Market
8 March 2024 4:36pm
27 March 2024 10:56am
29 March 2024 9:13am
Here's what you missed at World Wildlife Day 2024
7 March 2024 9:02pm
15 March 2024 2:42pm
Machine Learning Postdoc Position, Understory
29 February 2024 11:56pm
Data data everywhere, but not a byte to use!
29 February 2024 7:13am
Calculating Wingbeat Frequency From Accelerometer Data
19 February 2024 9:07pm
27 February 2024 8:28pm
Great suggestion! Diving bird studies and their analyses are actually what has helped me get thus far with solving this problem. They happen to have done quite the same thing as I'm trying to do, just with more behaviors added. I believe the study was done with murres and kittiwakes.
Best,
Travis
27 February 2024 8:48pm
I'm very close to solving the problem. Just waiting for a function to run on a fairly large dataset to see the results. I will share the repository link with you when it gets accomplished!
The species I'm working with roost atop cave ceiling as also drop from there to get airborne!
Yes, they are triaxial (Technosmart) and body mounted right on their backs.
So far, I have created thresholds for different metrics derived from the accelerometer data. Essentially, I sectioned out a bunch of ACC data where I am positive flight is occurring, and did the exact same with roosting, and crawling around/scratching(activity while roosting). From there, I plotted the distribution of all the metrics to see which metrics have unique distributions that were significantly different than roosting/activity.
Using those distributions, I created thresholds for the important metrics in which all flight behavior was either above or below a certain value for that metric. This got me to being able to construct a decision tree based on these metrics which had pretty solid accuracy.
The downside is a small chunk of flight from the beginning and end of flight bouts are not being included in the behavior classification. I noticed that their wbf during those small chunk are indicative of flight and am going to try and add wbf as the last decision on the tree to improve the accuracy of it.
VeDBA is also being included and calculated and based on the values for the thresholds I have created for flight it should not matter how high their head is, rather how low it is, when x y and z thresholds are also met. If that makes sense.
Hope I answered most of your questions!
27 February 2024 8:59pm
Were you ever able to solve the problem? Interestingly enough, I begin a seal bio-logging study next year!
Also, you are correct. The errors were occurring during short bout flights as well as some spectral leakage, but I may have solved the problem by lower the window size. I've also corrected for the spectral leakage by creating a separate function that identifies any significant changes in calculated WBF that last < 2 seconds, then counts number of heave amplitudes within 1 second. I'm using an fft for the calculations and am just waiting for a function to run on a larger dataset to see if everything came out the way I am hoping for. Fingers crossed.
Best,
Travis
SMART Partnership Director
21 February 2024 4:32pm
Computer Vision for Ecology Workshop 2025 Call for Applications
12 February 2024 9:29pm
Post-doc possition - Field spanning movement ecology, ecology of fear, bio-logging science, behavioral ecology, and ecological statistics
10 February 2024 7:20am
Bio-Logging Science Symposium
9 February 2024 3:59pm
Southern African Wildlife Management Association Conference 2024
6 February 2024 12:20pm
Image analysis with volunteers
26 January 2024 6:30pm
27 January 2024 9:14am
I have a little experience with Timelapse and would say it is definetely worth the invested time.
The developer Saul Greenberg has made a ton of documentation on its use and is also very approachable in person, if you have any issues.
I can only highly recommend it.
27 January 2024 9:01pm
Thank you! This is encouraging. It's also nice to know that Saul is approachable for problem-solving issues.
Jupyter Notebook: Aquatic Computer Vision
25 January 2024 5:50am
26 January 2024 1:46pm
This is quite interesting. Would love to see if we could improve this code using custom models and alternative ways of processing the video stream.
27 January 2024 4:07am
This definitely seems like the community to do it. I was looking at the thread about wolf detection and it seems like people here are no strangers to image classification. A little overwhelming to be quite honest 😂
While it would be incredible to have a powerful model that was capable of auto-classifying everything right away and storing all the detected creatures & correlated sensor data straight into a database - I wonder if in remote cases where power (and therefore cpu bandwidth), data storage, and network connectivity is at a premium if it would be more valuable to just be able to highlight moments of interest for lab analysis later? OR if you do you have cellular connection, you could download just those moments of interest and not hours and hours of footage?
27 January 2024 6:11am
Am working on similar AI challenge at the moment. Hoping to translate my workflow to wolves in future if needed.
We all are little overstretched but it there is no pressing deadlines, it should be possible to explore building efficient model for object detection and looking at suitable hardware for running these model on the edge.
Analysis Methods for Localization with Networks of Fixed Radio Receivers
26 January 2024 2:36pm
Need advice - image management and tagging
12 January 2024 7:55pm
15 January 2024 8:47pm
Interesting, Iʻll give it a shot. Looks like this could save me some time.
Thanks for the explanation @wade!
24 January 2024 5:16pm
I have no familiarity with Lightroom, but the problem you describe seems like a pretty typical data storage and look up issue. This is the kind of problem that many software engineers deal with on a daily bases. In almost every circumstance this class of problem is solved using a database.
In fact, a potentially useful analysis is that the Lightroom database is not providing the feature set you need.
It seems likely that you are not looking for a software development project, and setting up you own DB would certainly require some effort, but if this is a serious issue for your work, you hope to scale your work up, or bring many other participants into your project, it might make sense to have an information system that better fits your needs.
There are many different databases out there optimized for different sorts of things. For this I might suggest taking a look at MongoDB with GridFS for a couple of reasons.
- It looks like you meta data is in JSON format. Many DBs are JSON compatible, but Mongo is JSON native. It is especially good at storing and retrieving JSON data. Its JSON search capabilities are excellent and easy to use. It looks like you could export your data directly from Lightroom into Mongo, so it might be pretty easy actually.
- Mongo with the GridFS package is an excellent repository for arbitrarily large image files.
- It is straightforward to make a Mongo database accessible via a website.
- They are open source (in a manner of speaking) and you can run it for free.
Disclaimer: I used to work for MongoDB. I don't anymore and I have no vested interest at all, but they make a great product that would really crush this whole class of problem.
25 January 2024 8:32am
Hi!
I would take a look at
Although developed for camera trap imagery, it is by no means restricted to such.
Cheers,
Lars
How are Outdoor Fire Detection Systems Adapted for Small Forest Areas, Considering the Predominance of Indoor Fire Detectors?
8 January 2024 4:27pm
22 January 2024 6:35pm
Fire detection is a sort of broad idea. Usually people detect the products of fire, and most often this is smoke.
Many home fire detectors in the US use a radioactive source and measure the absorption of the radiation by the air. More smoke means more absorption.
For outdoor fire detection, PM2.5 can be a very good smoke proxy, and outdoor PM2.5 sensing is pretty accessible.
This one is very popular in my area.
Wildlife Conservation for "Dummies"
9 January 2024 10:02pm
10 January 2024 11:24pm
Maybe this is obvious, but maybe it's so obvious that you could easily forget to include this in your list of recommendations: encourage them to hang out here on WILDLABS! I say that in all seriousness: if you get some great responses here and compile them into a list, it would be easy to forget the fact that you came to WILDLABS to get those responses.
I get questions like this frequently, and my recommended entry points are always (1) attend the WILDLABS Variety Hour series, (2) lurk on WILDLABS.net, and (3) if they express a specific interest in AI, lurk on the AI for Conservation Slack.
I usually also recommend that folks visit the Work on Climate Slack and - if they live in a major city - to attend one of the in-person Work on Climate events. You'll see relatively little conservation talk there, but conservation tech is just a small subset of sustainability tech, and for a new person in the field, if they're interested in environmental sustainability, even if they're a bit more interested in conservation than in other aspects of sustainability, the sheer number of opportunities in non-conservation-related climate tech may help them get their hands dirty more quickly than in conservation specifically, especially if they're looking to make a full-time career transition. But of course, I'd rather have everyone working on conservation!
13 January 2024 3:14am
Some good overview papers I'd recommend include:
- Besson, M., Alison, J., Bjerge, K., Gorochowski, T. E., Høye, T. T., Jucker, T., ... & Clements, C. F. (2022). Towards the fully automated monitoring of ecological communities. Ecology Letters, 25(12), 2753-2775.
- Speaker, T., O'Donnell, S., Wittemyer, G., Bruyere, B., Loucks, C., Dancer, A., ... & Solomon, J. (2022). A global community‐sourced assessment of the state of conservation technology. Conservation Biology, 36(3), e13871.
- WILDLABS-led research! Led by @TaliaSpeaker and @StephODonnell
- Lahoz-Monfort, J. J., & Magrath, M. J. (2021). A comprehensive overview of technologies for species and habitat monitoring and conservation. BioScience, 71(10), 1038-1062.
- Tuia, D., Kellenberger, B., Beery, S., Costelloe, B. R., Zuffi, S., Risse, B., ... & Berger-Wolf, T. (2022). Perspectives in machine learning for wildlife conservation. Nature communications, 13(1), 792.
- Stowell, D. (2022). Computational bioacoustics with deep learning: a review and roadmap. PeerJ, 10, e13152.
- I'm biased towards bioacoustics because that's what I focus on, but this regardless this is an excellent horizon scan of AI/ML for conservation and acoustics!
- Borowiec, M. L., Dikow, R. B., Frandsen, P. B., McKeeken, A., Valentini, G., & White, A. E. (2022). Deep learning as a tool for ecology and evolution. Methods in Ecology and Evolution, 13(8), 1640-1660.
I'd also encourage you to follow the #tech4wildlife hashtags on social media!
15 January 2024 4:27pm
I'm also here for this. This is my first comment... I've been lurking for a while.
I have 20 years of professional knowledge in design, with the bulk of that being software design. I also have a keen interest in wildlife. I've never really combined the two; and I'm starting to feel like that is a waste. I have a lot to contribute. The loss of biodiversity is terrifying me. So I’m making a plan that in 2024 I’m going to combine both.
However, if I’m honest with you – I struggle with where to start. There are such vast amounts of information out there I find myself jumping all over the place. A lot of it is highly scientific, which is great – but I do not have a science background.
As suggested by the post title.. a “Wildlife Conservation for Dummies” would be exactly what I am looking for. Because in this case I’m happy to admit I am a complete dummy.
Opinions or experience with Firetail movement analysis software?
29 December 2023 9:39pm
9 January 2024 9:15am
Hi Travis!
I'm a developer in the Firetail team and also worked with R a lot during my PhD.
The goals of both projects are quite different. Using Firetail definitely does not mean you can no longer use R or vice versa. Firetail's focus is on the interactive, visual exploration and annotation of your data. It is meant to be used by scientists, conservationists or stakeholders analysing their projects.
It may be used to pinpoint regions/time-windows and visualize data suitable for downstream analysis in R, or generate reports regularily. Firetail won't replace algorithm X using a distinct set of parameters as required by reviewer R, but it will help to understand your data and tell the story.
The basic workflows of Firetail are meant to be intuitive and we seek to support a wide range of data out of the box (plus, 1:1 customer service when you run into problems).
We also implement additional workflows based on ideas that we receive from you all and seek to integrate interfaces to whatever upstream/downstream tools you require for your daily work.
Feel free to contact me ([email protected]) for specific questions or just use this thread :)
Best,
Tobias
12 January 2024 12:48am
Hi Tobias!
This is great to hear. This seems to be exactly what I am looking for as I approach my accelerometry data, looking to identify certain behaviors through thresholds then manually verify. This sounds like a great compliment to what I've done in R with the data so far. Thanks for the info! I will most definitely give this a try!
I may take you up on the offer of emailing you with a couple quick questions once I start (I appreciate that!)
Best,
Travis
13 January 2024 6:10am
Perfect. Looking forward to hearing from you!
Presentation opportunity: Text analysis for conservation (NACCB 2024)
8 January 2024 4:05pm
13th International Conference on Climate Informatics
18 December 2023 12:20pm
Data Viz Inspo for the Holidays
11 December 2023 8:42pm
Automatic extraction of temperature/moon phase from camera trap video
29 November 2023 1:15pm
1 December 2023 2:35pm
Hi Lucy
As others have mentioned, camera trap temperature readouts are inaccurate, and you have the additional problem that the camera's temperature can rise 10C if the sun shines on it.
I would also agree with the suggestion of getting the moon phase data off the internet.
1 December 2023 2:38pm
Do you need to do this for just one project? And do you use the same camera make/model for every deployment? Or at least a finite number of camera makes/models? If the number of camera makes/models you need to worry about is finite, even if it's large, I wouldn't try to solve this for the general case, I would just hard-code the pixel ranges where the temperature/moon information appears in each camera model, so you can crop out the relevant pixels without any fancy processing. From there it won't be trivial, exactly, but you won't need AI.
You may need separate pixel ranges for night/day images for each camera; I've seen cameras that capture video with different aspect ratios at night/day (or, more specifically, different aspect ratios for with-flash and no-flash images). If you need to determine whether an image is grayscale/color (i.e., flash/no-flash), I have a simple heuristic function for this that works pretty well.
Assuming you can manually define the relevant pixel ranges, which should just take a few minutes if it's less than a few dozen camera models, I would extract the first frame of each video to an image, then crop out the temperature/moon pixels.
Once you've cropped out the temperature/moon information, for the temperature, I would recommend using PyTesseract (an OCR library) to read the characters. For the moon information... I would either have a small library of images for all the possible moon phases for each model, and match new images against those, or maybe - depending on the exact style they use - you could just, e.g., count the total number of white/dark pixels in that cropped moon image, and have a table that maps "percentage of white pixels" to a moon phase. For all the cameras I've seen with a moon phase icon, this would work fine, and would be less work than a template matching approach.
FYI I recently wrote a function to do datetime extraction from camera trap images (it would work for video frames too), but there I was trying to handle the general case where I couldn't hard-code a pixel range. That task was both easier and harder than what you're doing here: harder because I was trying to make it work for future, unknown cameras, but easier because datetimes are relatively predictable strings, so you know when you find one, compared to, e.g., moon phase icons.
In fact maybe - as others have suggested - extracting the moon phase from pixels is unnecessary if you can extract datetimes (either from pixels or from metadata, if your metadata is reliable).
5 December 2023 10:09pm
camtrapR has a function that does what you want. i have not used it myself but it seems straightforward to use and it can run across directories of images:
https://jniedballa.github.io/camtrapR/reference/OCRdataFields.html
WILDLABS Awards 2024: Supporting accessible, affordable, and effective innovation for nature
1 December 2023 11:00am
ICOTEQ launch TAGRANGER® system of products
23 November 2023 1:25pm
AWMS Conference 2023
Catch up with The Variety Hour: November 2023
16 November 2023 12:59pm
Insight; a secure online platform designed for sharing experiences of conservation tool use.
7 November 2023 1:01pm
A secure platform designed for those working to monitor & protect natural resources. Insight facilitates sharing experience, knowledge & tools to increase efficiency & effectiveness in conservation. By sharing we reduce time & money spent to find, test, & implement solutions.
26 March 2024 2:11pm