Posted On March 2, 2021
Here is a step-by-step guide that shows you how to take the derivative of the Cross Entropy function for Neural Networks and then shows you how to use that derivative for Backpropagation.
⭐ NOTE: When I code, I use Kite, a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I love it! https://www.kite.com/get-kite/?utm_medium=referral&utm_source=youtube&utm_campaign=statquest&utm_content=description-only
NOTE: This StatQuest assumes that you are already familiar with...
The main ideas behind neural networks: https://youtu.be/CqOfi41LfDw
The main ideas behind backpropagation: https://youtu.be/IN2XmBhILt4
Neural networks with multiple inputs and outputs: https://youtu.be/aObJUevCVDc
ArgMax and SoftMax: https://youtu.be/KpKog-L9veg
Cross Entropy: https://youtu.be/6ArSys5qHAU
For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/
If you'd like to support StatQuest, please consider...
Patreon: https://www.patreon.com/statquest
...or...
YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...a cool StatQuest t-shirt or sweatshirt (USA/Europe): https://teespring.com/stores/statquest
(everywhere):
https://www.redbubble.com/people/starmer/works/40421224-statquest-double-bam?asc=u&p=t-shirt
...buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/
...or just donating to StatQuest!
https://www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
https://twitter.com/joshuastarmer
0:00 Awesome song and introduction
5:47 dCE_setosa with respect to b3
11:19 dCE_virginica with respect to b3
15:03 Other derivatives
16:09 Backpropagation with cross entropy
#StatQuest #NeuralNetworks #CrossEntropy