Welcome to Android Central! Which phone? Color inversion doesn't make it black & white -- it just inverts the colors.
Go to Settings>Display and see if there's a Greyscale option.
If you have any power-saving mode on, turn it off.
If you have an LG phone, look for the Reader mode (which might be in Settings>Accessibility or Settings>Display).