We consider a queueing inventory with one essential and m optional items for sale. The system evolves in environments that change randomly. There are n environments that appear in a random fashion governed by a Marked Markovian Environment change process. Customers demand the main item plus none, one, or more of the optional items, but were restricted to at most one unit of each optional item. Service time of the main item is phase type distributed and that of optional items have exponential distributions with parameters that depend on the type of the item, as well as the environment under consideration. If the essential item is not available, service will not be provided. The lead times of optional and main items have exponential distributions having parameters that depend on the type of the item. The condition for stability of the system is analyzed by considering a multi-dimensional continuous time Markov chain that represent the evolution of the system. Under this condition, various performance characteristics of the system are derived. In terms of these, a cost function is constructed and optimal control policies of the different types of commodities are investigated. Numerical results are provided to give a glimpse of the system performance. View Full-Text