  By constructing certain maps, this note completes the answer of the Question:
For which closed orientable 3-manifold $N$, the set of mapping degrees
$\c{D}(M,N)$ is finite for any closed orientable 3-manifold $M$?
