Current medical practice deals with a variety of multimodal information (X-ray film, ultrasound, CT, MR, ECG and EEG, laboratory results, medical records, etc.) Diagnosis and treatment demand an integrated view of this information including the patient's record and history. This paper describes multimodal imaging approaches to such a system with regard to (i) user interface, (ii) data management (including access control), (iii) registration and modality matching based on reference models, and (iv) interface to the modalities.