Looks like that's a feature of the mod. It makes the game more like D2, so levels will be reloaded and mobs respawned each time you enter the game.
Progress is "saved" by reaching waypoints. You shouldn't have to clear the whole level, just make it far enough that you reach the next waypoint. There should be one on every second level.