Our work aims at developing or expliciting bridges between Bayesian Networks and Natural Exponential Families, by proposing discrete exponential Bayesian networks as a generalization of usual discrete ones. In this paper, we illustrate the use of discrete exponential Bayesian networks for Bayesian structure learning and density estimation. Our goal is to empirically determine in which contexts these models can be a good alternative to usual Bayesian networks for density estimation.