I think the main concern is that the oils in Earl grey might cause mold, possibly it could weaken the scoby but like the previous commenter said, scobys are pretty Hardy, it should be fine in the future. However I know a few brewers that only use Earl grey because they simply prefer the flavor...