If you really think that people don't smoke tobacco for the taste of it, you've never had good tobacco. A good cigar or pipe tobacco has a deep and complex flavor, and the types of flavors vary from one to another. Cigars are described with specific terms like spicy, creamy, beefy, woody, fruity, grassy, and with "notes" of distinct flavors like chocolate or coffee. "Muddy" and/or "sour" are how bad cigars are usually described.
"Muddy" tobacco is usually cheap tobacco; grown in poor soil, uncured and unaged. It is used in cigarettes, which are not smoked for the tobacco, but as a nicotine delivery medium. Since it lacks the complex flavors derived from good soil and the aging process, tar is added to give it sweetness and smoothness, and dangerous chemical preservatives replace the curing process. And nicotine is added, making it far more addictive than natural tobacco, which has about 20% the nicotine.
It is also worth noting that high-quality tobacco is not generally inhaled; the tar added to the cheap stuff aids in inhalation. And inhalation also disturbs the flavor, as the exhaled smoke tastes, frankly, of lung; and lingers in the mouth.
If your tobacco is "muddy", it is either bad tobacco, or you smoke too much to discern flavors. I don't think the latter is the case, since you say you usually only smoke once per day. If you decide to smoke again, I'd suggest not smoking something you can buy in a supermarket. Like cigarettes, cheap cigars are just a drug delivery system. In the meantime, don't suggest that those of us who enjoy fine tobacco smoke bad-tasting weeds in order to get a buzz. It's just not true. I'm no more addicted to tobacco than I am to steak. I enjoy both, but neither are a staple of my lifestyle.