Yes. Turn your multimeter to ohms. First, touch your two leads together. Remember that number, as its the internal resistance of your meter. Any resistance measurement you take will need that number subtracted from it.
Then, take a one foot length of your wire, and put one lead on each end. Doesn't matter which goes where. Take the resistance you get and subtract the first number you got. The result is the resistance of one foot of wire.
Then just google kanthal/nichrome resistance per foot and match up the number. Boom! Now you know.