VHB tape is wonderful stuff to stick things together. It was created for attaching windows to things, with no fasteners. However, I just had an illustrative example of when not to use it.
I was very impressed with the VHB tape on the lunar lander dome. It had a steel frame to stick to.  Straight and smooth.
Maybe out of inertia, I also put it on the little triangular windows of the lunar lander. Later I realized the tape looked too wide on those tiny windows and I vowed to trim it back when I bought a tall enough ladder to reach.
I got the ladder.  It turned out that all I had to do was push a bit and the windows folded back in. So I could then remove the tape.
Two lessons. For VHB tape to work well, the contact surface must be both flat and smooth. Many of you can do that. I seem to not have that skill nor ability in hard to reach places.
The second lesson is the VHB tape must be kept dry. Due to no ladder, I could not protect it with my caulk.
My triangular windows are now stopped in and bedded with caulk.  The caulk can span the sketchy surface and gaps.
If you can do and flat, fair and smooth contact surface, go for it. If not, use adhesive caulk, like the System 3, two part polyurethane.

In contrast, I have a solar powered motion light stuck above the front door.   It was stuck on with a couple of strips of VHB tape.  Turns out the light is defective and won’t work.  I not only can’t  remove it, I can hang from it.  And swing.  Gonna take a chisel maybe.