In 3-4 year old kids are more confident in coloring. They're not trying to draw freely, and act within the circuit, trying to repeat the figure bends.
You should pick soft triquetrous pencils for a small kid. It is sufficient to have a set of six basic colors. When coloring, try pronouncing the name of each color, this helps the baby to remember them.