Hello!
It sounds like you have understood fundamentalism correctly. It refers to a very conservative/orthodox form of religious belief that focuses on strict, literal interpretation of religious texts (Quran, Bible etc.)
Extremism is similar, but has a more general meaning. Whereas fundamentalism means strict religious belief, Extremism refers to any extreme beliefs or ideas: religious, political, social etc.
For example, the Nazis and Daesh/ISIS could both be called extremists because they hold views that many would call 'extreme'. However, you would not call the Nazis 'fundamentalists' because their ideas are not based on an alleal to strict readings of scripture. By contrast, Daesh justify violence by referring to what they call 'true' Islam.