Do people whose native tongue uses grammatical gender find it easy or difficult to learn the parts of another language that do not use grammatical gender?

To give a basic example of my question: In Spanish, the sentence "La casa es roja," translates as, "The house is red." In English, the grammatical gender agreement doesn't exist here.

I am a native English speaker, and I find learning the grammatical genders to be tedious. So would the inverse be true for native Spanish etc. speakers learning that portion of English?

(I'm only comparing one minor part of learning a new language, not learning the language as a whole)