You can remove all of the instruments AND any non-structural portion of the instrument panel. That will likely save several pounds from a "stock" airplane. All your flight instruments can be on your phone, which is in the pilot's pocket and not part of the empty weight. Although it would not make sense for anything other than meeting the letter of 103, you can remove the pitot tube and ten or fifteen feet of tubing that connects the pitot to the instruments, and all the Adel clamps and what-not that clamps the tube to the airframe, that's probably nearly a pound altogether. A thin welded aluminum tank, instead of a thicker plastic Jerry can can, will save a little bit if you are splitting hairs.
I highly recommend against it, but if you are wanting to demonstrate the legality of the aircraft, you can use slightly thinner webbing for the seat restraints, and sew the individual shoulder straps to the lap belt halves, getting rid of a pound of chrome steel buckles and such. The FAA guidelines for certified airplanes now indicate that the end of the bolt can be flush with the end of the self-lock nut... it used to be two threads, now it is zero. So shorter bolts that just meet this rule will save something, and then remember there are low-profile self-lock nuts that are physically smaller and probably weigh less. Being smaller, they allow a bolt that is even slightly shorter yet.
There are probably a lot of places whereyou can cut lightening holes OTHER than the main spar webs. I'm not that familiar with the Ultra Cruiser, but I'm sure thereare opportunities to add a little more fabrication time and get an ounce or two off of parts.
The point is that if you need to make weight, there are things you can do. Make no mistake, you will be paying for this in time, cost, or losing something that is nice to have (ASI).
I know that this will be seen as an absolute crime against all that is holy, but there are also lighter engines for the Ultracruiser than the VW derivatives. The 36HP Polini or perhaps others from Simonini and others, using a higher gear ratio and a larger diameter propeller, would give it plenty of low-end grunt.
Foam seat upholstery weight a couple of pounds, you might be able to use something lighter, an inflatable cushion instead of foam, upholstery weighs something, etc. etc.