Like anything in life — it depends.
If you are coming from a poorer country and have limited budget, you might find the hotels quite expensive.
But if you are coming with some foreign currencies in your pocket that amounts a lot in Taka, you are good to go. You might even find the country “cheap”as many Westerners have found it to be.
Hotels are expensive and not quite up to the international standard, I would tell you beforehand. Outside of Dhaka, it is even harder to find a descent hotel that isn't exorbitant. If you are on a budget, I would recommend getting in touch with some local travel blogger or YouTuber in advance. That would save you quite some money and in addition you will experience Bangladeshi hospitality, which amazes people (or so I am told).
The country is a boiling pot of chaos. If you are looking for a serene peaceful visit to a countryside etc, this is probably not the place for it. Even if you are in the countryside, be prepared to be constantly visually examined by local people ( it's harmless curiosity, nothing bad). These things aside, there are some really raw naturally beautiful places spread across the country. Take your time to visit some of those.
Few foreigners have faced danger from general local people, but do not disregard safety. You should know, in case of mugging and/or robbery or fraud etc, police will not be of any help. At least we locals try to avoid going to the police just to save the time, money and hassle. Be careful and always have someone that you can contact in case of emergency.
The street food are absolutely a treàt for the foodies, if you have a strong stomach.
All in all, it is quite an interesting place for a tourist, if you are truly interested in exploring (instead of trying to find the comfort of home outside). But I would not lie to you, you gotta be prepared. Tourism in the country is a very young and underdeveloped industry. There are some great travel blogs on the topic, search and read them. Be prepared and you'd love the chaos.