OK. I found it. If you force garbage collection, the recordset objects get released and the COM interface is happy.

Added this code:
System.GC.Collect();

System.GC.WaitForPendingFinalizers();