In this paper, we present our techniques of multimodal fusion and fission for an intelligent robotic application. The fusion of data from different sensors produces an event that needs implementation. The fission process produces a detailed set of actions that are to be implemented. Before such set of actions is implemented, this set of actions is evaluated first in a virtual environment to determine if the actions can be carried out in a real-world environment. If an obstacle is noted during the virtual evaluation, this implies that the action cannot be carried out in real environment.