CADDIS-Fly
Summary
- There are 19 posts — by 8 authors — in this topic.
-
Posts with files From File Date James Dare Feb 24 16:26 NZDT - Latest post made by Colin Meurk at Mar 01 22:30 NZDT
As we are discussing in the "National database - Consortium approach?" topic, http://dataversity.org.nz/r/topic/2ZAsRMxXLUQvvNuywq11Oy one potential outcome of Dataversity is the formation of consortia to develop software. CADDIS-Fly is a freshwater biological monitoring database that was developed by Paul Barter http://dataversity.org.nz/p/7qg4sSF5S9MlSNcQti3ira of Cawthron, http://cawthron.org.nz/ for a consortium comprising Horizons, West Coast Regional Council and Hawkes Bay Regional Council. CADDIS-Fly is the "Cawthron Archival and Data Delivery Information System" (CADDIS), adapted specifically for the above regional councils. It provides for data management at a greater resolution than similar national databases, but stores data in a standard format that can easily be uploaded to NZFFDB or FBIS. The development of CADDIS-Fly was supported by funding from Envirolink. You can read more about CADDIS-Fly in the following project progress report http://envirolink.govt.nz/reports/documents/417-HZLC42.pdf written by James Lambie http://dataversity.org.nz/p/jameslambie of Horizons in June 2008. As both James Lambie and Paul Barter are in this group, if you have any questions about CADDIS and CADDIS-Fly, please ask them here. Paul has agreed to demonstrate CADDIS-Fly at the national Dataversity workshop on 19 & 20 March. http://dataversity.org.nz/r/post/5gj2EviF6rJFc3OWvxlkgJ James and Paul, if you have comments to add, please post them here, too. It would be particularly interesting to know if you have some plans for making CADDIS-Fly available to other councils, on some basis.
Dan -- Dan Randow Projects Director OnlineGroups.Net ph +64-3-377-5377 +64-27-431-4928 Kenton Chmbrs, 190 Hereford St PO Box 739, Christchurch, 8140 Aotearoa (New Zealand) http://onlinegroups.net http://groupserver.org http://twitter.com/danrandow skype: vonrandow
Thanks Dan. I'm in the process of meeting with Paul B to chat about CADDIS.
Cheers Paul -----Original Message----- From: <email obscured> <email obscured>] On Behalf Of Dan Randow Sent: Friday, 6 March 2009 5:55 p.m. To: <email obscured> Subject: [dataversity public discussion] CADDIS-Fly As we are discussing in the "National database - Consortium approach?" topic, http://dataversity.org.nz/r/topic/2ZAsRMxXLUQvvNuywq11Oy one potential outcome of Dataversity is the formation of consortia to develop software. CADDIS-Fly is a freshwater biological monitoring database that was developed by Paul Barter http://dataversity.org.nz/p/7qg4sSF5S9MlSNcQti3ira of Cawthron, http://cawthron.org.nz/ for a consortium comprising Horizons, West Coast Regional Council and Hawkes Bay Regional Council. CADDIS-Fly is the "Cawthron Archival and Data Delivery Information System" (CADDIS), adapted specifically for the above regional councils. It provides for data management at a greater resolution than similar national databases, but stores data in a standard format that can easily be uploaded to NZFFDB or FBIS. The development of CADDIS-Fly was supported by funding from Envirolink. You can read more about CADDIS-Fly in the following project progress report http://envirolink.govt.nz/reports/documents/417-HZLC42.pdf written by James Lambie http://dataversity.org.nz/p/jameslambie of Horizons in June 2008. As both James Lambie and Paul Barter are in this group, if you have any questions about CADDIS and CADDIS-Fly, please ask them here. Paul has agreed to demonstrate CADDIS-Fly at the national Dataversity workshop on 19 & 20 March. http://dataversity.org.nz/r/post/5gj2EviF6rJFc3OWvxlkgJ James and Paul, if you have comments to add, please post them here, too. It would be particularly interesting to know if you have some plans for making CADDIS-Fly available to other councils, on some basis. Dan -- Dan Randow Projects Director OnlineGroups.Net ph +64-3-377-5377 +64-27-431-4928 Kenton Chmbrs, 190 Hereford St PO Box 739, Christchurch, 8140 Aotearoa (New Zealand) http://onlinegroups.net http://groupserver.org http://twitter.com/danrandow skype: vonrandow ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/2gEYCO8MGDBBPOBmH4h0Zr To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net You are prohibited from distributing this E-mail without permission. If you have received this E-mail by mistake or are not the intended recipient, please notify the sender and erase the message immediately. This E-mail message and any accompanying data is confidential and may be legally privileged. The Nelson City Council does not warrant or guarantee that this communication is free of errors, virus or interference. This e-mail has been scanned and cleared by MailMarshal.
Hi All, I have started using the CADDIS-fly database in more depth (loading up some invertebrate and periphyton data). While I am having "isses" there are not to do with the database itself. I will elucidate further at the workshop in Wellington next week. The main points for this posting are; CADDIS-Fly is easy to acquire and a useful place to hold aqautic data. It will (or is easily able to be made to) render data in such a way that the data can be migrated to Fresh Water Biodiversity Information System (FBIS) or National Fresh Water Fish Database (both NIWA national data management systems). CADDIS-fly versions have the "advantage" over national (centralised) data management systems in that if your council prefers that you hold on to your data, you can. But you still have a data management system that (if we all use it) is standardised between councils. CADDIS-fly may be a permanent feature of Horizons data management or may be interim until we have worked out whether FBIS would serve us better. The decision to move to centralised systems is both operational and political. Points I am sure will arise at the meeting next week. Jim Lambie
Thanks for your comments. Could CADDIS be developed or linked to a terrestrial records data base? Paul F
-----Original Message----- From: <email obscured> <email obscured>] On Behalf Of James Lambie Sent: Monday, 9 March 2009 10:54 a.m. To: Dataversity Public Discussion Subject: Re: [dataversity public discussion] CADDIS-Fly Hi All, I have started using the CADDIS-fly database in more depth (loading up some invertebrate and periphyton data). While I am having "isses" there are not to do with the database itself. I will elucidate further at the workshop in Wellington next week. The main points for this posting are; CADDIS-Fly is easy to acquire and a useful place to hold aqautic data. It will (or is easily able to be made to) render data in such a way that the data can be migrated to Fresh Water Biodiversity Information System (FBIS) or National Fresh Water Fish Database (both NIWA national data management systems). CADDIS-fly versions have the "advantage" over national (centralised) data management systems in that if your council prefers that you hold on to your data, you can. But you still have a data management system that (if we all use it) is standardised between councils. CADDIS-fly may be a permanent feature of Horizons data management or may be interim until we have worked out whether FBIS would serve us better. The decision to move to centralised systems is both operational and political. Points I am sure will arise at the meeting next week. Jim Lambie ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/3WJN8ZfIkPchM216RzDBPS To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net You are prohibited from distributing this E-mail without permission. If you have received this E-mail by mistake or are not the intended recipient, please notify the sender and erase the message immediately. This E-mail message and any accompanying data is confidential and may be legally privileged. The Nelson City Council does not warrant or guarantee that this communication is free of errors, virus or interference. This e-mail has been scanned and cleared by MailMarshal.
Could CADDIS be developed or linked to a terrestrial records data base? Yes, though it is something Horizons probably wouldn't do since we have a terrestrial ecosystems database in Access anyway . To make CADDIS work, all you would need to do is add terrestrial taxa to the taxon list. Plant names can be harvested from Landcare Research. Animal names can be harvested from Horizons if you like. You would have to add survey methodologies we use for terrestrial systems, but this would be a relatively simple exercise I think. Alternalitvely, if you have quite simple data recording needs, you could use the Biological Recording Network (www.nzbrn.org.nz) as described by Colin Meurk in last weeks postings. Another alternative, if you like Access databases and the bugs that come with them, is to have a copy of Horizons EcoBase. However, I would recommend seeing Auckland's EcoBase Mike McMurtry first, as it might be a better solution for your needs. Jim Lambie
-----Original Message----- From: <email obscured> <email obscured>] On Behalf Of Paul Fisher Sent: Tuesday, 10 March 2009 8:56 a.m. To: <email obscured> Subject: Re: [dataversity public discussion] CADDIS-Fly Thanks for your comments. Could CADDIS be developed or linked to a terrestrial records data base? Paul F -----Original Message----- From: <email obscured> <email obscured>] On Behalf Of James Lambie Sent: Monday, 9 March 2009 10:54 a.m. To: Dataversity Public Discussion Subject: Re: [dataversity public discussion] CADDIS-Fly Hi All, I have started using the CADDIS-fly database in more depth (loading up some invertebrate and periphyton data). While I am having "isses" there are not to do with the database itself. I will elucidate further at the workshop in Wellington next week. The main points for this posting are; CADDIS-Fly is easy to acquire and a useful place to hold aqautic data. It will (or is easily able to be made to) render data in such a way that the data can be migrated to Fresh Water Biodiversity Information System (FBIS) or National Fresh Water Fish Database (both NIWA national data management systems). CADDIS-fly versions have the "advantage" over national (centralised) data management systems in that if your council prefers that you hold on to your data, you can. But you still have a data management system that (if we all use it) is standardised between councils. CADDIS-fly may be a permanent feature of Horizons data management or may be interim until we have worked out whether FBIS would serve us better. The decision to move to centralised systems is both operational and political. Points I am sure will arise at the meeting next week. Jim Lambie ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/3WJN8ZfIkPchM216RzDBPS To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net You are prohibited from distributing this E-mail without permission. If you have received this E-mail by mistake or are not the intended recipient, please notify the sender and erase the message immediately. This E-mail message and any accompanying data is confidential and may be legally privileged. The Nelson City Council does not warrant or guarantee that this communication is free of errors, virus or interference. This e-mail has been scanned and cleared by MailMarshal. ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/1vcqLGyKlnm31PdpQzVRkj To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net Horizons Regional Council | 24 hr freephone 0508 800 800 | www.horizons.govt.nz This email is covered by the disclaimers which can be found here: http://www.horizons.govt.nz/default.aspx?pageid=219
Thanks for your question, Paul and for your comments, James, I'll add a question, and some links. >> Could CADDIS be developed or linked to a terrestrial records data base? > To make CADDIS work, all you would need to do is add terrestrial taxa to > the taxon list. Plant names can be harvested from Landcare Research. Who or where in Landcare Research would provide plant name taxa? > Alternalitvely, if you have quite simple data recording needs, you could > use the Biological Recording Network (www.nzbrn.org.nz) as described by > Colin Meurk in last weeks postings. There is a detailed description of NZBRN, and some discussion about it in the following topic. http://dataversity.org.nz/r/topic/3I8BeZiy5J1LTJI4gTOtcj > Another alternative, if you like Access databases and the bugs that come > with them, is to have a copy of Horizons EcoBase. However, I would > recommend seeing Auckland's EcoBase Mike McMurtry first, as it might be > a better solution for your needs. There's a description of ARC's Ecobase in the Showcase. http://dataversity.org.nz/resources/showcase/ Here's some discussion about ARC's Ecobase. http://dataversity.org.nz/r/topic/1DUdJwPQVQS4kssgwFQmL2
cheers, Dan
Thanks again Dan for supplimenting the converstion with the exisiting links The Landcare Herbarium Plant Names Database is described and can be accessed here; (http://www.landcareresearch.co.nz/databases/db_details.asp?Database_Col lection_ID=3) Aaron Wilton is the primary contact. Horizons has (had?) a data use agreement with Landcare Research that allowed us to download the flora to EcoBase as needed. I have not undertaken a download since I took over curation of EcoBase, so I am not overly familiar with the mechanisms required. Jim L.
-----Original Message----- From: <email obscured> <email obscured>] On Behalf Of Dan Randow Sent: Tuesday, 10 March 2009 11:02 a.m. To: <email obscured> Subject: Re: [dataversity public discussion] CADDIS-Fly Thanks for your question, Paul and for your comments, James, I'll add a question, and some links. >> Could CADDIS be developed or linked to a terrestrial records data base? > To make CADDIS work, all you would need to do is add terrestrial taxa > to the taxon list. Plant names can be harvested from Landcare Research. Who or where in Landcare Research would provide plant name taxa? > Alternalitvely, if you have quite simple data recording needs, you > could use the Biological Recording Network (www.nzbrn.org.nz) as > described by Colin Meurk in last weeks postings. There is a detailed description of NZBRN, and some discussion about it in the following topic. http://dataversity.org.nz/r/topic/3I8BeZiy5J1LTJI4gTOtcj > Another alternative, if you like Access databases and the bugs that > come with them, is to have a copy of Horizons EcoBase. However, I > would recommend seeing Auckland's EcoBase Mike McMurtry first, as it > might be a better solution for your needs. There's a description of ARC's Ecobase in the Showcase. http://dataversity.org.nz/resources/showcase/ Here's some discussion about ARC's Ecobase. http://dataversity.org.nz/r/topic/1DUdJwPQVQS4kssgwFQmL2 cheers, Dan ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/4h6s4DKcIqo8LpT8Il8VV6 To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net Horizons Regional Council | 24 hr freephone 0508 800 800 | www.horizons.govt.nz This email is covered by the disclaimers which can be found here: http://www.horizons.govt.nz/default.aspx?pageid=219
For people interested in terrestrial invertebrates, there is a potentially simple survey method and recording system based on insect and mite damage to plants. It is called Plant-SyNZ. details of the concept are at www.crop.cri.nz/home/plant-synz/index.php Nicholas Martin >>> Dan Randow <email obscured>> 10-Mar-09 11:01 a.m. >>> Thanks for your question, Paul and for your comments, James, I'll add a question, and some links. >> Could CADDIS be developed or linked to a terrestrial records data base? > To make CADDIS work, all you would need to do is add terrestrial taxa to > the taxon list. Plant names can be harvested from Landcare Research. Who or where in Landcare Research would provide plant name taxa? > Alternalitvely, if you have quite simple data recording needs, you could > use the Biological Recording Network (www.nzbrn.org.nz) as described by > Colin Meurk in last weeks postings. There is a detailed description of NZBRN, and some discussion about it in the following topic. http://dataversity.org.nz/r/topic/3I8BeZiy5J1LTJI4gTOtcj > Another alternative, if you like Access databases and the bugs that come > with them, is to have a copy of Horizons EcoBase. However, I would > recommend seeing Auckland's EcoBase Mike McMurtry first, as it might be > a better solution for your needs. There's a description of ARC's Ecobase in the Showcase. http://dataversity.org.nz/resources/showcase/ Here's some discussion about ARC's Ecobase. http://dataversity.org.nz/r/topic/1DUdJwPQVQS4kssgwFQmL2
cheers, Dan ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/4h6s4DKcIqo8LpT8Il8VV6 To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net On 1 December 2008 HortResearch merged with Crop & Food Research to create The New Zealand Institute for Plant and Food Research Limited. "The contents of this email are confidential and may be subject to legal privilege. If you are not the intended recipient you must not use, disseminate, distribute or reproduce all or any part of this email or attachments. If you have received this email in error, please notify the sender and delete all material pertaining to this e-mail. Any opinion or views expressed in this email are those of the individual sender and may not represent those of The New Zealand Institute for Plant and Food Research Limited."
How has CADDIS-Fly been developing in the last year? Can someone give us
an update?
It would be interesting to know something about any or all of the following:
How many councils are now using CADDIS-Fly?
What is the scope of ecological data that
CADDIS-FLy is in use for?
Which of the councils using CADDIS-Fly are
regularly updating FBIS with data from their
local database?
What improvements have been made to CADDIS-Fly,
and which councils have updated their local systems
to incorporate those improvements?
What improvements are planned for CADDIS-Fly?
And, can someone refresh my memory: does
CADDIS-Fly consume authoritative taxonomic data
from an external source? How is that handled?
Can someone provide a more comprehensive description
of CADDIS-Fly than the one in our system guide?
http://dataversity.org.nz/guide/systems/caddis/
For those interested in background on CADDIS-Fly, we have a page in the
System Guide,
http://dataversity.org.nz/guide/systems/caddis/
and some discussion in this topic.
http://dataversity.org.nz/r/topic/6DJgeMPMd2tmlxASrpNw3L
There is also this Envirolink project progress report.
http://www.envirolink.govt.nz/PageFiles/32/417-HZLC42.pdf
Dan -- Dan Randow Dataversity Facilitator http://dataversity.org.nz and Chief Wrangler OnlineGroups.Net +64-3-377-5377 +64-27-431-4928 409 Kenton Chmbrs, 190 Hereford St, Christchurch PO Box 739, Christchurch, 8140 Aotearoa (New Zealand) http://onlinegroups.net http://groupserver.org http://twitter.com/danrandow Skype: vonrandow
Dan, Is the venue for the conference 18-19 march set up for a poster presentation? Are any other group considering bringing posters? Benno Kappers MSc NHMS BDI project leader, herpetofauna administrator Department of Conservation PO Box 644 Napier Phone (DDI): 06 834 4865 Fax : 06 834 4869 Cell : 027 291 6922 www.doc.govt.nz/nzherpatlas
-----Original Message-----
From: <email obscured>
<email obscured>] On Behalf Of Dan
Randow
Sent: Thursday, 4 March 2010 10:42 a.m.
To: <email obscured>
Cc: <email obscured>
Subject: [dataversity public discussion] CADDIS-Fly
How has CADDIS-Fly been developing in the last year? Can someone give us
an update?
It would be interesting to know something about any or all of the
following:
How many councils are now using CADDIS-Fly?
What is the scope of ecological data that
CADDIS-FLy is in use for?
Which of the councils using CADDIS-Fly are
regularly updating FBIS with data from their
local database?
What improvements have been made to CADDIS-Fly,
and which councils have updated their local systems
to incorporate those improvements?
What improvements are planned for CADDIS-Fly?
And, can someone refresh my memory: does
CADDIS-Fly consume authoritative taxonomic data
from an external source? How is that handled?
Can someone provide a more comprehensive description
of CADDIS-Fly than the one in our system guide?
http://dataversity.org.nz/guide/systems/caddis/
For those interested in background on CADDIS-Fly, we have a page in the
System Guide,
http://dataversity.org.nz/guide/systems/caddis/
and some discussion in this topic.
http://dataversity.org.nz/r/topic/6DJgeMPMd2tmlxASrpNw3L
There is also this Envirolink project progress report.
http://www.envirolink.govt.nz/PageFiles/32/417-HZLC42.pdf
Dan
--
Dan Randow
Dataversity Facilitator
http://dataversity.org.nz
and Chief Wrangler
OnlineGroups.Net
+64-3-377-5377 +64-27-431-4928
409 Kenton Chmbrs, 190 Hereford St, Christchurch PO Box 739,
Christchurch, 8140 Aotearoa (New Zealand) http://onlinegroups.net
http://groupserver.org http://twitter.com/danrandow
Skype: vonrandow
-----------------------------------------
Full text of this topic in Dataversity Public Discussion:
http://dataversity.org.nz/r/topic/7I9kSN9xol9iYtH5VjvlyV
To leave Dataversity Public Discussion, email
<email obscured>?Subject=unsubscribe
Start your own free groups and site with OnlineGroups.Net
http://onlinegroups.net
Host your own online groups site with
GroupServer http://groupserver.org
##############################################
This e-mail (and attachments) is confidential
and may be legally privileged.
##############################################
Hi All, I can answer Dan's questions only from Horizons' point of view - Paul Barter is perhaps best to address the number of councils now involved, future improvements, and database description. Development continues with Paul releasing a number of versions this year with incremetnal modifications that make the data entry much faster and tidier. I have been finding a few bugs but every time I call Paul up report them, he is already on the case. I'm about to have a crack at running a conversion from NZMG to NZTM coordinates and either Paul or I will report the success of this at the workshop. The scope for data seems endless to me. We are not using many of the options that are available. At the moment we store all of our macro-invert count data and MCIs (and QMCIs), we record our periphyton in sample/transect sequence and CADDIS calculates the average percent cover. Recording substrate composition, temperature, and conductivity is intuitive amd easy to get in and out of the database. I am about to embark of a mass migration of Chlorophyll-A data into the database. We get Cawthron to do our Chla analysis, so in the future, it should be even easier to get the data from the lab into the database (a lot less manual entry. We probably will harvest NZFWFDB records for the region and pop these in CADDIS, though this is not a high priority. We're putting our fish data directly into NZFWFDB rather than holding on to it. We're not actively exporting to FBIS for an inordinate number of reasons (the main one being, with CADDIS, we don't need to use FBIS!). Improvements: We're still using version 3.10 but Paul has indicated there's a version 4 on the way. The improvments to date (that we have noticed) have been ones that speed up data entry and eradicate bugs. As stated above, there will be a tool for converting coordinates to NZTM soonish. I am about to set up a table that relates all of the sites in CADDIS to Hilltop and Paul is working on ways to export CADDIS data as Hilltop files so that data from both databases can be analysed in one (Hilltop) environment. Athoritative names: Nup - we're using the taxa list that Cawthron sent in the first version of CADDIS. I have added other "taxa" for periphyton. I don't forsee mapping the CADDIS taxon list back to the NZOR being an overly complicated process and is perhaps something for future development - Paul? Hope this is informative.
Jim
-----Original Message-----
From: <email obscured>
<email obscured>] On Behalf Of Dan
Randow
Sent: Thursday, 4 March 2010 10:42 a.m.
To: <email obscured>
Cc: <email obscured>
Subject: [dataversity public discussion] CADDIS-Fly
How has CADDIS-Fly been developing in the last year? Can someone give us
an update?
It would be interesting to know something about any or all of the
following:
How many councils are now using CADDIS-Fly?
What is the scope of ecological data that
CADDIS-FLy is in use for?
Which of the councils using CADDIS-Fly are
regularly updating FBIS with data from their
local database?
What improvements have been made to CADDIS-Fly,
and which councils have updated their local systems
to incorporate those improvements?
What improvements are planned for CADDIS-Fly?
And, can someone refresh my memory: does
CADDIS-Fly consume authoritative taxonomic data
from an external source? How is that handled?
Can someone provide a more comprehensive description
of CADDIS-Fly than the one in our system guide?
http://dataversity.org.nz/guide/systems/caddis/
For those interested in background on CADDIS-Fly, we have a page in the
System Guide,
http://dataversity.org.nz/guide/systems/caddis/
and some discussion in this topic.
http://dataversity.org.nz/r/topic/6DJgeMPMd2tmlxASrpNw3L
There is also this Envirolink project progress report.
http://www.envirolink.govt.nz/PageFiles/32/417-HZLC42.pdf
Dan
--
Dan Randow
Dataversity Facilitator
http://dataversity.org.nz
and Chief Wrangler
OnlineGroups.Net
+64-3-377-5377 +64-27-431-4928
409 Kenton Chmbrs, 190 Hereford St, Christchurch PO Box 739,
Christchurch, 8140 Aotearoa (New Zealand) http://onlinegroups.net
http://groupserver.org http://twitter.com/danrandow
Skype: vonrandow
-----------------------------------------
Full text of this topic in Dataversity Public Discussion:
http://dataversity.org.nz/r/topic/7I9kSN9xol9iYtH5VjvlyV
To leave Dataversity Public Discussion, email
<email obscured>?Subject=unsubscribe
Start your own free groups and site with OnlineGroups.Net
http://onlinegroups.net
Host your own online groups site with
GroupServer http://groupserver.org
Horizons Regional Council | 24 hr freephone 0508 800 800 | www.horizons.govt.nz
This email is covered by the disclaimers which can be found here:
http://www.horizons.govt.nz/default.aspx?pageid=219
Thanks for that excellent update on CADDIS-Fly, James. > Development continues with Paul releasing a number of versions this > year with incremetnal modifications that make the data entry much > faster and tidier. I have been finding a few bugs but every time I > call Paul up report them, he is already on the case. It's great that CADDIS-FLy is so actively maintained. > I'm about to have a crack at running a conversion from NZMG to NZTM > coordinates and either Paul or I will report the success of this at > the workshop. I'll schedule a session for CADDIS-Fly at the workshop. > We're putting our fish data directly into NZFWFDB rather than holding > on to it. Does this mean that you are only using CADDIS-Fly as a short-term repository for your fish data, and that NZFFD is the primary repository for Horizons' fish data? > We're not actively exporting to FBIS for an inordinate > number of reasons (the main one being, with CADDIS, we don't need to > use FBIS!). I am sure that this is will be relevant to the discussion about FBIS. http://dataversity.org.nz/r/topic/6RIWMlABizvaHNRXmNP0OC
Dan
In response to you Dan, >Does this mean that you are only using CADDIS-Fly as a short-term repository for your fish data, and that NZFFD is the primary repository for Horizons' fish data? Presently, were not using CADDIS-Fly at all for the fish data. NZFFD is the primary data entry portal and repository.
-----Original Message----- From: <email obscured> <email obscured>] On Behalf Of Dan Randow Sent: Tuesday, 9 March 2010 5:37 p.m. To: <email obscured> Subject: Re: [dataversity public discussion] CADDIS-Fly Thanks for that excellent update on CADDIS-Fly, James. > Development continues with Paul releasing a number of versions this > year with incremetnal modifications that make the data entry much > faster and tidier. I have been finding a few bugs but every time I > call Paul up report them, he is already on the case. It's great that CADDIS-FLy is so actively maintained. > I'm about to have a crack at running a conversion from NZMG to NZTM > coordinates and either Paul or I will report the success of this at > the workshop. I'll schedule a session for CADDIS-Fly at the workshop. > We're putting our fish data directly into NZFWFDB rather than holding > on to it. Does this mean that you are only using CADDIS-Fly as a short-term repository for your fish data, and that NZFFD is the primary repository for Horizons' fish data? > We're not actively exporting to FBIS for an inordinate > number of reasons (the main one being, with CADDIS, we don't need to > use FBIS!). I am sure that this is will be relevant to the discussion about FBIS. http://dataversity.org.nz/r/topic/6RIWMlABizvaHNRXmNP0OC Dan ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/4LEIwm6oDxeBp5nCJIMWBK To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net Host your own online groups site with GroupServer http://groupserver.org Horizons Regional Council | 24 hr freephone 0508 800 800 | www.horizons.govt.nz This email is covered by the disclaimers which can be found here: http://www.horizons.govt.nz/default.aspx?pageid=219
Hi Everyone, I guess I should introduce myself first; my name is James, I'm the new data management officer at Environment Southland. I started this Job in early February, and I've spent the past month learning about our systems and where data is currently being kept. I stumbled across CADDIS-Fly on one of our shared-drives, and it turns out we have had this database since 2009; however, no-one has been using it. Most of our SOE Macro-invertebrate count data is currently kept in an excel file, with a different sheet for each year stating the sites across the top, and taxa down the side (see attached photo). I would like to import this information into CADDIS-FLY and ensure that future samples are processed through this database. The problem is: when I try to import a CSV file via 'Import Data --> Import Delimited Text Data', I get the error: "3078, The Microsoft Jet database engine cannot find the input table or query 'tblTempImport'. Make sure it exists and that its name is spelt correctly" (see second photo). Has anyone ever encountered this before? Is there another way I can import our data into CADDIS-Fly without manually entering it? Thanks so much for your help, it's much appreciated.
Regards, James
Hi James thanks for your introduction, and a quick outline of your wee problem. I do not use CADDIS, so can not really help out there. BUT, I am involved in a project that is to upgrade NIWAs FBIS (Freshwater Biodata Information System) database, which will hopefully turn it from a rather inelegant, clumsy beast that few people use, into something more user friendly, useful and popular. I mention this because one of the things I want to highlight is that fact that the new FBIS will be designed and built to interrogate other databases via a web-service protocol, as long as the structure of the database in known. So, if you are using CADDIS, then hopefully we can create a web-service interface to allow FBIS to talk to your database. This means that anyone wanting info on Southland invertebrate data can simply access a wide range through the FBIS portal. Note, however, that FBIS will also be able to import / access other database structures, so you are not required to use CADDIS. Again, as long as we know the format of your data, we can write a web-service link to allow FBIS to talk to your dataset. Your description of the data also highlights two very common mistakes that many people make with biological survey data. Myself, and a colleague at NIWA ChCh - Martin Unwin - have been collating ALL regional council from throughout NZ for MfE. Although some councils have very well defined data structures in excell, a lot do not. There are 2 common problems that we have observed: 1. Many many councils use separate excell pages for different years / sites etc. This makes combing data from multiple years / sites into a single spreadhseet very difficult, especially if different taxa are found in the different years / sites. 2. Many councils enter data as a full matrix, with - like you have - sites across the top as columns, and species along the side (as rows). This is hugely problematic for a number of reasons. Firstly, on older versions of excell, the number of columns was limited. This means that you run out of space to add new columns fairly quickly. It also means that there is a very very large chance of having different numbers of rows between years as new organisms are found - again making combining data problematic. Many datasets also have somewhat meaningless titles in the species rows, such as a heading for "Mayflies", or "Caddisflies". These rows then contain no further information. So, why have them? Most ecologists already know that Deleatidium is a mayfly or Olinga is a Caddisfly. It is also (I feel) pretty difficult and inefficient to enter data as a full matrix, especially when the vast majority of values are simply "0". The simple solution to this is to have 1 spreadsheet with 4 columns in it: Site, Date, Taxa, Abundance. Then, you just add data for each taxa you found at each site, and on each time. Thus, if you sampled Site A in 2009 and 2010 and found 13, and 26 taxa in each year, all you enter is the same Site and Date information 13 and 26 times as new lines for the 2 years, and the the individual taxa and their abundances. Pivot tables are then used to create the full species x site matrix that we all use. This is much, much simpler, and there is no problem of trying to merge data arrays with different numbers of columns. I simply mention this beacuase, as mentioned, FBIS will be able to interrogate other data bases, as long as we know the structure. So, instead of using CADDIS, another possibility is to use Excell in a more elegant maner than was done by your predecessors. If you would like to discuss this further, please feel free to contact either myself or Martin Unwin at NIWA ChCh. Regards Alastair
Thanks for this information Alastair. Just a note for others to avert potential confusion - CADDIS stores the data completely flat. What Alastair is referring to a historic propensity when we were using excel to store data - one which we sometimes still do for reporting purposes. Alastair - just as a matter of interest about Horizons' data - what is the last date? Since you are referring to a problem that should no longer exist between NIWA and Horizons, I am a little puzzled about the provenance of the material you have been passed. Cheers, Jim Horizons Regional Council | 24 hr freephone 0508 800 800 | www.horizons.govt.nz T www.twitter.com/horizonsrc | FB www.facebook.com/horizonsrc This email is covered by the disclaimers which can be found here: www.horizons.govt.nz/exclusion-of-liability
Hi James (Dare) Your problem sounds like an Access issue linking Tables to the Jet server, something that your IT guys can fix. Otherwise Paul Barter (Cawthron) is the brains behind CADDIS and may be able to point you in the right direction. Most of our lab results are from Cawthron so we had Envirolink funding to develop CADDIS to meet our needs, which included exporting CADDIS data to Hilltop Manager (hts format), and automating the MCI calculation and annual classification of our river ecology monitoring sites. With regard to input of data - I use 'Append bulk data from Excel' to copy Sonde water quality results from a worksheet. I gave our MCI ecologist a 'satellite' copy of CADDIS to input the taxa IDs, which is then exported to me as a CADDIS csv file. Keep in mind that CADDIS was designed to store lab samples and results, so the hierarchy is Project, Survey based rather than Site based. So you need to be careful how you deal with data that may be linked to various studies, and not necessarily a point source e.g. sanitation survey that may link to bathing water, river ecology and sampled at various locations along a reach. The proposed Bay of Plenty / Gtr Wellington / Auckland biodata management software will hopefully be tailored to manage regional council data and national reporting standards! I can offer more help on using CADDIS if required - and there should be no issue giving you a copy of what we have. I suspect each copy of CADDIS in circulation has been adapted to suit personal needs. And to that end no one is using a 'standardised' taxa list...In summary, the system works OK for us but there are glitches and no technical support, so far from adequate. All the best Paul Fisher Nelson City Council
-----Original Message-----
From: <email obscured>
<email obscured>] On Behalf Of James Dare
Sent: Friday, 24 February 2012 4:27 p.m.
To: <email obscured>
Subject: Re: [Dataversity] CADDIS-Fly
― Attachment links are at the end of this email ―
Hi Everyone,
I guess I should introduce myself first; my name is James, I'm the new data
management officer at Environment Southland. I started this Job in early
February, and I've spent the past month learning about our systems and where
data is currently being kept.
I stumbled across CADDIS-Fly on one of our shared-drives, and it turns out we
have had this database since 2009; however, no-one has been using it. Most of
our SOE Macro-invertebrate count data is currently kept in an excel file, with
a different sheet for each year stating the sites across the top, and taxa down
the side (see attached photo). I would like to import this information into
CADDIS-FLY and ensure that future samples are processed through this database.
The problem is: when I try to import a CSV file via 'Import Data --> Import
Delimited Text Data', I get the error:
"3078, The Microsoft Jet database engine cannot find the input table or query
'tblTempImport'. Make sure it exists and that its name is spelt correctly"
(see second photo).
Has anyone ever encountered this before? Is there another way I can import our
data into CADDIS-Fly without manually entering it? Thanks so much for your
help, it's much appreciated.
Regards,
James
Dataversity Public Discussion now contains the following files
http://dataversity.org.nz/r/file/26135-2012-02-24T032612Z
Name: CADDIS Error.gif
Type: image/gif
Size: 50KB
http://dataversity.org.nz/r/file/26136-2012-02-24T032613Z
Name: MACRO.gif
Type: image/gif
Size: 39KB
-----------------------------------------
Full text of this topic in Dataversity Public Discussion:
http://dataversity.org.nz/r/topic/7Jt4tKzS10iFI1BjwAhGPu
To leave Dataversity Public Discussion, email
<email obscured>?Subject=unsubscribe
Start your own free groups and site with OnlineGroups.Net
http://onlinegroups.net
Host your own online groups site with
GroupServer http://groupserver.org
You are prohibited from distributing this E-mail without permission. If you
have received this E-mail by mistake or are not the intended recipient, please
notify the sender and erase the message immediately. This E-mail message and
any accompanying data is confidential and may be legally privileged. The Nelson
City Council does not warrant or guarantee that this communication is free of
errors, virus or interference. This e-mail has been scanned and cleared by
MailMarshal.
Thanks Everyone, Your replies have been very interesting and useful. I have taken Alistair's advice and written a macro that flattens our matrix data into five columns: sample date, site number, site name, taxa, and abundance. This should make things easier when it comes time to upload to CADDIS-Fly. With regard to our upload problem: I’m currently talking to Paul Barter and we should be getting the new version of CADDIS-Fly in the near future. Hopefully this will solve our problem, or at least make in-roads towards a solution. I will keep you posted.
Regards, James
maybe i've missed something here, but i don't understand the need for this facility when NZBRN already does it? it has all these fields and more colin
________________________________________ From: <email obscured> <email obscured>] On Behalf Of James Dare <email obscured>] Sent: Thursday, 1 March 2012 4:33 p.m. To: <email obscured> Subject: Re: [Dataversity] CADDIS-Fly Thanks Everyone, Your replies have been very interesting and useful. I have taken Alistair's advice and written a macro that flattens our matrix data into five columns: sample date, site number, site name, taxa, and abundance. This should make things easier when it comes time to upload to CADDIS-Fly. With regard to our upload problem: I’m currently talking to Paul Barter and we should be getting the new version of CADDIS-Fly in the near future. Hopefully this will solve our problem, or at least make in-roads towards a solution. I will keep you posted. Regards, James ----------------------------------------- Full text of this topic in Dataversity Public Discussion: http://dataversity.org.nz/r/topic/3WjghtXnGeuCJnLwfHn5R2 To leave Dataversity Public Discussion, email <email obscured>?Subject=unsubscribe Start your own free groups and site with OnlineGroups.Net http://onlinegroups.net Host your own online groups site with GroupServer http://groupserver.org Please consider the environment before printing this email Warning: This electronic message together with any attachments is confidential. If you receive it in error: (i) you must not read, use, disclose, copy or retain it; (ii) please contact the sender immediately by reply email and then delete the emails. The views expressed in this email may not be those of Landcare Research New Zealand Limited. http://www.landcareresearch.co.nz
Loading…
Privacy | Acceptable Use | Terms of Service | About OnlineGroups.Net | Contact OnlineGroups.Net
Start an OnlineGroups.Net site for easier email collaboration in your organization.
Powered by GroupServer, the open source web-based mailing list manager.