We have proposed a system called Attentive Workbench (AWB) that is designed to support desktop work. AWB is the system which estimates a worker’s condi- tion using some sensors and assists a worker using movable trays and projectors from both physical and informational viewpoints. A method for estimating an AWB user’s intention is proposed and presented herein. An AWB user expresses his/her intention bu pointing a finger at a necessary tray. For estimating which tray a user needs, the system uses Dynamic Bavesian Network to integrate the sensor data obtained from user’s pointing gestures and user’s past action sequences. A description of the experimental results will demonstrate the usefulness of the method proposed here.