The optimization of deep neural networks almost always relies on reducing the value of a loss function. For classification tasks, the loss function we used was cross entropy. Could we have instead just have used accuracy as the loss function? Why or why not? Hint: Think about what the loss function would look like

Answer using up to 3 sentences max.

Question

The optimization of deep neural networks almost always relies on reducing the value of a loss function. For classification tasks, the loss function we used was cross entropy. Could we have instead just have used accuracy as the loss function? Why or why not? Hint: Think about what the loss function would look like

Answer using up to 3 sentences max.

BlackTom AI · Accepted Answer

The question asks whether we could have used accuracy as the loss function for training deep neural networks on classification tasks, instead of cross-entropy, and to provide reasoning for the answer.
First, accuracy measures the proportion of correct predictions and is a discrete, non-differentiable metric that only changes when a prediction crosses the decision threshold (e.g., from incorrect to correct). This means it provides essentially no gradient information to guide optimization, so gradient-based methods cannot use it to adjust network weights.
Second, cross-entropy, by contrast, is smooth and differentiable with respect to the network’s outputs, yielding meaningful gradients at every training example that indicate how to adjust predictions to become more probable for the correct class. This enables effective optimization via backpropagation, whereas accuracy cannot drive learning in a fine-grained way.
Third, using accuracy as a loss would also create optimization dynamics that are non-smooth and often plateaus, making it difficult for the model to learn from intermediate states or handle mini-batch updates consistently. In short, accuracy is a useful evaluation metric but not a suitable objective for training neural networks; cross-entropy provides the necessary differentiable signal for gradient-based optimization.

类似问题

Is the following statement true or false? In the products of methylation-hydrolysis, every -OH group corresponds to the position of a glycosidic bond in the starting polysaccharide.

Which of the follwoing structures represents amylopectin?

Which of the following is true about an aldopentose?I. It is a monosaccharide.II. It contains a CHO groupIII. It is a disaccharide.IV. It is an oligosaccharide.

For stock A, we have 𝛽 𝑖 = 0.70. Suppose the expected market risk premium next year is 9% and the risk-free rate is 3%. What is the expected return of this stock based on the CAPM? (Please answer in % and round to 2 decimal places. If the answer is 8.057%, then in the box, write 8.06)

The following graph shows the Security Market Line in the current economy. If a stock has a β of 1.2, what is the expected return of this stock based on the CAPM? (Please answer in % and round to 2 decimal places. If the answer is 8.057%, then in the box, write 8.06)

更多留学生实用工具

智能学习助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单