We’re hanging out in the primary visual cortex for this next duo of challenges. We appreciate your hard work on the most recent batch and hope to have feedback to share soon from our scientists. In the meantime, you can access our new challenges here.
Heads up: Mouse-V1-12 and Mouse-V1-13 are both closing tomorrow morning at approximately 10am, Pacific time. We are currently preparing two neurons to give everyone fresh material to work with, and those will go up at the same time the other challenges close. We’re so close to getting finished with these two, so be sure to get all your tracing in.
We have a another dose of feedback available to our community today. Did you see our previous post? If not, go check it out after you’re done here.
For this neuron, about 60% axon was captured, and 95% dendrite was captured this time. We noted one major branching error in the dendrites and a small amount of false positive captured, mostly in the lower right area. In the image below, gold standard is red (axon) and blue (dendrite); consensus is green. The reconstructions and the maximum intensity projection (MIP) image are not to scale.
We're very impressed with this one. The community reached about 90% axon captured (with a couple short segments we probably missed) and 99% dendrite (one minor error, but also a couple of dendritic tips we missed). Almost zero false positive signal. Awesome!
On this neuron, we would say the community captured about 75% axon, 85% dendrite (a couple of long bits missed, which were probably missed due to missing comments in those areas). Still pretty good overall. A few false positives, but not enough to compromise the overall helpfulness of this as a starting point.
Eager for feedback on earlier challenges?
Check out the Scientist notes on 03: Mouse Neuron V1.
Read more from the Gold Standard Comparisons V1-04 through V1-07
Curious about the phrase “gold standard”?
Check up on this thread. Other questions? Bring them to the General Discussion Forum.
Just in time for the weekend, we have lots of fantastic feedback via scientist “alexh” from the Allen Institute for Brain Science. He has been providing everyone with frequent comments on each challenge to date. Have you been regularly checking in on your traces? (You may be surprised. He often points out areas that need tracing, and paying attention to those can boost your score.) Whenever possible, he also tries to provide us with a summary of “how we did” afterwards.
In case you missed it from the forums, the "gold standard" label is given to things that have already been currently reconstructed by experts (either elsewhere or at the Allen Institute for Brain Science) that we use to evaluate against to measure the effectiveness of our tools and help identify areas that could use more education efforts.
This is a spiny cell, with essentially no axon (the axon exits the soma and is immediately cutoff at the surface of the slice). The final consensus failed to capture only four short segments, but most importantly there were zero false positives.
Below is an image of the overlay with consensus in green and gold standard in red.
Because they agree so closely, you may find it difficult to see the consensus in some places. The reasons we think this consensus was so successful include an excellent signal-to-noise in the images (which can be seen in the maximum intensity projection (MIP) below-right), and no axon present.
This is a spiny cell, with a decent amount of axon. Our gold standard does not include the axon for this cell, but I can still do a good comparison. Only one dendritic segment was missed, and it was partially obscured by the soma, so it is an understandable miss. The axon captured in the consensus looks great. This consensus would be an excellent starting point for us. It would definitely save us time compared with the autotrace as a starting point. There are a few false positives (not enough to be problematic), including the bubble edge that we discussed last month. Here is the overlay image and the MIP (note that the axon is often invisible from the MIP image):
This is an aspiny cell with tons of axon. Importantly, there is not much false positive in the consensus. The dendrites were mostly captured, though a few segments, branches and tips were missed. There was a lot of missed axon, with about 60% captured. Of note, there was a bunch of axon that was missed in the upper-left of the image. The reason for this is that there was no connection back to the main structure and the gap was larger than the fog would allow tracers to see. However, as is, the consensus would be a good starting point for us.
This is an aspiny cell with poor image/cell quality and lots of axon. There is more missed dendrite than in a typical case (5 large segments). You can see from the maximum intensity projection (MIP) that even the dendrites are much more difficult to discern for this cell than previous cells. The axon is about 50% complete. There are numerous axon segments that are captured, but only as a series of dots (not a continuous line). There is also a lot of false positive signal throughout the consensus. We attribute this to the overall poor quality of the image/cell; low signal-to-noise is very difficult to reconstruct. This consensus is a great starting place.
Bring us your science questions on the
General Discussion Forum.
Eager for feedback on earlier challenges?
Scientist notes on 03: Mouse Neuron V1 is available for review.
Look for another feedback wrapup post on Monday. Good job, everyone, and thank you alexh for taking time out to send post-challenge notes and your continued feedback so we can keep learning.