We present a cell tracking method for time-lapse confocal microscopy (3D) images that uses dynamic hierarchical data structures to assist cell and colony segmentation and tracking. During the segmentation, the cell and colony numbers and their geometric data are recorded for each 3D image set. In tracking, the colony correspondences between neighboring frames of time-lapse 3D images are first computed using the recorded colony centers.