"stay up all night" is "밤새다"(pam-sae-da) in Korean.
Night only, but refers to the fact that dawn comes and is used in the sense of "spend remain happened night throughout". Overnight and or study, it is used in the sense of such or spent the night with a cup of sake. 밤새우다 (bam se u da) is synonym.