fit-PC2 + 30GB SSD + Ubuntu8.04
Room temperature about 28 C - 32 C
The temperatures detected :
Thermal Sensor 0 is about 62 C - 70 C
Thermal Sensor 1 is about 58 C - 65 C

The case is so hot that I cannot touch on it over two seconds.
Even in the idling state.

Except the hot, it works very well.

Is my fit-PC2 out of norm?

Sounds like your fit-PC2 is working at a high utilization in a warmer than usual ambient temperature.
However, since your system is equipped with SSD there should be no reliability problem.
This doesn't seem to be an out of spec unit.