Dashboard Legend Color

We have setup several charts on our dashboards using the 'Vertical Bar - Stacked' chart type. The problem is that depending on what data is displayed the color of the stacked bars change and so does the legend. Is there any way to have the legend colors remain the same all the time?