Graphene oxide (GO) is increasingly investigated as a reinforcing nanofiller for various hydrogels for biomedical applications for its superior mechanical strength. However, the reinforcing mechanism of GO in different hydrogel conditions has not been extensively explored and elucidated to date. Herein, we systematically examine the effects of various types of precursor molecules (monomers vs. macromers) as well as mode of GO incorporation (physical vs. covalent) on the mechanical properties of resulting composite hydrogels. In addition, incorporation of GO is also controlled by using either unmodified GO or methacrylic GO (MGO) which allows for covalent incorporation. The results in this study demonstrate that the interaction between GO and the surrounding network and its effect on the mechanical properties (i.e. rigidity and toughness) of composite hydrogels are highly dependent on both the type and concentration of precursors and the mode of crosslinking.