Written by Thomas Koetzing at Tuesday, 16 May 2006
It’s been now more than three years since the release of the first version of Microsoft User Profile Hive Cleanup Service (UPHClean) and the response in the community was tremendously. During that time many Companies had big problems with the use of roaming profiles and some of them still have. UPHClean was and is the only answer from Microsoft to solve their profile solution, in person Robin Caron. The task for Robin was easy (not really) “Build a utility or service that once and for all gets rid of problems with user profile not unloading”
A review from the past
1997 Microsoft published a White paper (Q161334) on profiles and policies explaining the usage. As many of you might remember, at that time multiframe (Terminal Services) technology was in the beginning and it’s no wonder that there is no reference to such an environment in the paper.
A quote from the White paper: “A roaming user is a user who logs on to the network from different computers at different times. This type of user may use a kiosk or may share a bank of computers with other users.”
This is clearly targeted on client server model but a very view people use it. Why only a view? Have you ever worked with Windows NT system policies, roaming profiles and FAT Clients? NT system policies are known as “Tattooing“ and was more a pain than easy administration. Later on, Microsoft’s Active Directory introduced folder redirection and group policies and they really solved the system policies issue and made it more useable.
Nowadays we have Windows 2003 R2 and Longhorn is knocking on the door but what did Microsoft with their roaming profiles solution? Citrix and Terminal Services are all over the place but in my opinion the profile handling was not improved by Microsoft! I also think Microsoft underestimates the profile problem, especially in a Server-based computing environment.
Where is the Profile virtualization, so I can copy it to a USB stick, store it somewhere on the Internet and can use it when ever I want to? Microsoft should finally start re-designing their profile solution. In the meantime everyone’s hope lies on UPHClean and smart free or 3rd. party solutions to get controlled and a stable profile solution.
UPHClean 1.x
It took six years before UPHClean was developed to help overcome profiles issues. The biggest problem was that profiles where sometimes not unloaded from the system registry. This often ends in a complete disaster where user got frustrated and Administrators with hairs on fire. The most common problem is an open registry handle from another process (like Microsoft installer) with higher rights as the user. This situation keeps the profile loaded in the system registry. This then might blow the server (when more and more profiles are stored in the registry, SRL) or might block re-logins etc. from the same user. Robins hive cleanup service really solves that problem and was a big relive for the community. UPHClean is one of my default installations for a Server (also Workstation) running Terminal Service and for many others too.
UPHClean 2.x
In the summer of 2005 I received an E-mail from Robin where he asked for some feedback about existing problems and how to improve the service further more. You have to understand that Robin is very committed to his task trying to solve the load- and unload of profiles from a windows system. So I started giving him feedback and suggestions about the UPHClean service.
New features and fixes
Timing fix In some situation there was a timing issue with Winlogon and UPHClean where Winlogon stopped trying to unload the profile before UPHClean finished it's work. This left the profile unloaded but UPHClean reported success in the event log and is actually right! UPHClean released the handles but there was no one unloading the profile. As a prove, regedt32 can be used to unload the user profile hive from the registry manually. The timing issue is now fixed.
Open file handles Besides open registry handles, open file handles to the user profile can have a bad influence of the load- and unload procedure. It’s almost the same as with open registry handles but this time winlogon can not remove or delete the profile from the local system. If the same user logs in again, he or she often get’s a new profile like username.000, username.001 etc. If the user then logs off, he or she will overwrite the central profile. Again, the user get’s frustrated.
The hive clean service can now close open file handles to user profiles during logoff! This is not without a risk; since UPHClean removes access to files or directories, a file could be corrupted. Also the process might be unable to write further data or it could cause the process to fail because it cannot read from the file. During testing this has not been found to be true but there is still a chance that it could happen. This is the reason why the remap feature is disabled by default.
To enable the feature you have to set the following registry key
Without enabling the remapping feature, UPHClean will automatically detect sharing violation during the user logoff and retry the failed operation for a small amount of time. You can control the amount of time using the SHARING_VIOLATION_DELAY value. This value is specified in millisecond and has a default value of 1000 millisecond.
File permissions In some cases a program might change file permissions or creates a new file/folder within the profile so badly that even the system can’t delete it. To resolve the issue you have to take ownership first before you can delete the file or folder. UPHClean takes care of those situations.
Real world problems When reading the new features, does something sound familiar for you? Ever encountered open file handle issue? I will give now some real example where UPHClean will help you.
VMware hgfs.dat VMware creates the hgfs.dat file in profile folder for the first user that logs in and keeps it open. When using roaming profiles you get a problem with that. (read VMware FAQ1317 for a solution)
SUN Java (JRE) In some cases SUN Java creates a folder called hsperfdata<username> with file permissions only set to the user and can not be removed by the system without taking ownership. SUN say’s this is by design (bug id 5042659)
Microsoft Internet explorer cookies and favorites Favorites and cookie files sometimes excide more than 255 chars and can only be deleted through the command line
Also suspects for open file handles: SAP SapGui (SapWorkDir), Imprivata SSO, Indexing Software, Virus scanner etc.
UPHClean Download Robin has start blogging in Februar 2008 about UPHClean but also about profiles in gerneral. The version 2.0.x can be downloaded through the blog or directly from this site:
Grouppolicy template for 2.0 beta settinngs UPHClean.adm
Comments
mhm Written by Gast on 2006-05-18 14:39:53 In einigen Fällen ändern Programme Berechtigungen auf Dateien oder Verzeichnisse innerhalb des Benutzerprofils derart, dass selbst das System keinen Zugriff mehr darauf hat.In so einer Situation muss erst der Besitz übernommen werden...
Kann das sein? Wenn "selbst das System" keinen Zugriff mehr hat, kann ich auch den Besitz nicht mehr übernehmen, oder?
..., bevor die Datei oder das Verzeichnis gelöscht werden kann. Auch hier hilft jetzt UPHClean automatisch.
Kann ich nicht bestätigen. Wir haben die neue Version von Microsoft bekommen, da bei uns auf einigen WTS'n ein Ordner im lokal gecachten Userprofil blockiert wird (Zugriff verweigert, Security-Tab verschwunden, erst nach reboot wieder da und löschen möglich). Hat leider das Problem nicht behoben.
D.
Rechte auf Ordner/Dateien Written by Thomas Koetzing on 2006-05-18 15:50:24Quote:
Security-Tab verschwunden, erst nach reboot wieder da und löschen
Das ist kein "normales" rechte Problem, das ist ein massives Problem am Server das mit Sicherheit andere Gründe hat.
How to install? Written by RedHand on 2006-07-03 10:53:27I tried to install and test this tool. After installation I was looking for a service under Services. But I could not find anything. I was reading the documentation of the tool. I saw some registry entries which I could not find in the registry after the installation. Did I miss something?
Written by Gast on 2006-07-03 14:31:03Habe das bekannte Problem Das Acrobat Reader diese Files im UserProfil erstellt und nicht mehr löschen kann,
erst nach dem Reboot kann man Files löschen
deshalb möchte ich UPHClean 2.0 Beta probieren
Written by Gast on 2006-11-21 00:14:32supi
Where's My Beta? Written by Guest on 2007-02-01 19:39:33I signed up to test the Beta last week and I still have not received the utility or any kind of notification. I have issues with the current version because of the Java Runtime and I was hoping this utility would be my savior.
Where's My Beta? (continued) Written by Guest on 2007-02-01 19:40:31 is my email.
Where's My Beta? Written by thomas koetzing on 2007-02-02 21:19:01Guys, the information is going directly to MICROSOFT. I have nothing to do with sending out the beta version. Use the form again to resend your request.
Index.dat-Dateien werden nicht gelöscht Written by Gast on 2007-05-04 19:23:28Hallo Thomas, zu dem Problem mit den Index.dat-Dateien, welche beim Abmelden eines Users auf dem Server nicht gelöscht werden und hierdurch ein Entladen des Profils verhindern, gibt es von Microsoft den KB933562-Artikel vom 30. März 07. Als Workaround wird empfohlen, den Client-DNS-Dienst auf dem Server zu aktivieren. Gruss V.
Written by Guest on 2007-05-09 21:04:12hi
Server hängt mit UPHClean 2.0 Written by Gast on 2007-05-25 09:40:35Hallo,
ich habe UPHClean auf Windows 2003 Servern mit Citrix Presentation Server 3.0 instlliert, weil ich auch immer Profilprobleme hatte (index.dat). Leider kann man sich seit der Installation nach einer gewissen Zeit nicht mehr am Server anmelden. Als Fehler erhalte ich ein Ereignis 1217:
Die Ausführung der Skripts für Gruppenrichtlinienobjekte hat das Zeitlimit überschritten und wird abgebrochen.
Nach einem Reboot funktioniert wieder alles.
Gruß
Wolfgang
Release Date Written by Guest on 2007-06-04 12:06:38Is there anyone who knows more about the final release date of this very nice poduct? Because its still in beta for such a long time we cannot implement it by our customers, while its solving a lot of pro(file)blems
Written by Guest on 2007-06-20 14:17:44i'd like to know if it's due a release any time soon too.. i'm surprised theres nothing on microsofts website about it.. 1.6d was released a month or two back but still doesn't resolve the open file handles issue..
Release Date Written by Thomas Koetzing on 2007-06-20 14:48:06I tried to contact Robin but I didn't get any response...
Written by Guest on 2007-06-21 21:03:42I signed up to test the Beta last 2 week and I still have not received the utility or any kind of notification. I signed up again today. Hope will receive it. Please let me know where I can download it. I heard that UPHClean version 1.8 is out there. Does anyone know where to download it ? Thanks.
Release Date Written by Thomas Koetzing on 2007-06-21 23:12:22Guys, the request is going DIRECTLY to Microsoft I have nothing to do with sending the source files.
Also the Beta is Version 2.x and I have no feedback about a Version 1.8 coming out. Actually Vista and Server 2008 has already some of the UPHClean function build in to the product.
Joe S. Written by Guest on 2007-08-24 17:11:39Open a support ticket with Microsoft to get the tool. That's what I did. I required it for my 64-Bit Citrix Servers.
Joe S. Written by Thomas Koetzing on 2007-08-24 19:09:10If you don't get the files within one week, E-Mail me and I will send it to you. Btw. I can see who has requested the UPHClean 2.x
Thomas
Written by Guest on 2007-10-17 08:17:04we have problem with deleting of cashed copies of roaming profiles on terminal servers
Written by Gast on 2007-11-27 10:19:00hi,
anyone knows when the UPHClean version for vista is available ? have problems with clients eventid 1500
thanks regards Marco
UPHClean for VISTA Written by Thomas Koetzing on 2007-11-27 10:27:01>anyone knows when the UPHClean >version for vista is available ? Never, since VISTA and Server 2008 comes with a profile service that includes functionallity of UPHClean 1.6d
Written by Gast on 2007-11-27 13:07:16@Thomas Koetzing
thanks for your info. and how can i activate or use this integrated tool on vista?
thanks Marco
UPHClean for VISTA Written by Thomas Koetzing on 2007-11-27 14:12:28>thanks for your info. and how can i activate >or use this integrated tool on vista? Nothing, it's enabled by default. If you have problems with profile service (as you have) you should report (open a call) it to Microsoft.
Written by Gast on 2007-12-26 01:56:05hi ich habe wohl auch das problem mit dem neustart/abmeld/reboot daher denke ich das die version mir weiterhilft! danke!
Written by Guest on 2008-01-04 08:14:27I've requested the tool, i'm quit surprised i cann't find any more info about this update of uphclean.
I would like to use this tool on our Windows 2003 64 bit MPS 4.0 servers.
What are the experinces of the test users with uphclean v2.0 so far?
Kann UPHClean nicht aus der Registry ent Written by Gast on 2008-04-27 18:06:48Können Sie mir bitte sagen, wie ich die vielen Rückstände, die die UHP Deinstallation in der Registry übriggelassen hat, entfernt werden können? z.B. Jede Menge Legacy-Einträge im Root-Verzeichnis. Vielen Dank, und hoffentlich verstehe ich alles, denn ich bin kleiner Laie. MfG Gast~Siggi P.
Registry-Optionen Written by Guest on 2008-10-07 08:49:31Gibt es irgendwo eine Liste der Registry-Optionen für UPH-Clean? Wir setzen die 1.6d auf XPSP3-Clients ein. Wobei es nichtreproduzierbare Probleme beim Unload der Roamingprofile gibt. Tippe auf Timingprobleme. Kann man die Beta2 bereits für den Produktivbetrieb empfehlen?
Registry-Optionen Written by Thomas Koetzing on 2008-10-07 08:54:05Die Registry Optionen sind alle in der Readme beschrieben. Timingprobleme mit 1.6d sind bekannt und sollten mit 2.x behoben sein. 2.x OHNE Trennen von Dateizugriffen sollte eigentlich unproblematisch sein...
Registry-Optionen Written by himbidas on 2008-10-07 12:38:17Hi Thomas, danke - bin fündig geworden. Schnell mal in deinem Forum registriert, thx too.
Zwei, drei Fragen zur 2erBeta. 1. Kann ich die einfach über die 1.6d installieren (auf Workstation XPSP3)? 2. Sollte man im Produktivbetrieb die ReMap-Funktion aktivieren? 3. Wenn ReMap-Funktion aktiv, wird dann trotzdem noch die 1000er-Delay-Funktion benutzt?
thx himbidas
Registry-Option Written by himbidas on 2008-10-07 15:08:31Wer lesen kann, ist klar im Vorteil. zu 1. hat sich erledigt - steht in der readme thx
Validation problem... Written by Guest on 2008-10-13 09:15:08...if one doesn't enter the "Code Validation" right, all entered information is lost. PLEASE, webmaster?!?
Please get this one out for 2008 / Vista Written by Guest on 2008-10-12 17:29:36I've lost track of how many times I've seen Vista / 2008 with User Hive issues, especially in networked scenarios. Many Microsoft pages tells one that the technology is already built into the OS...but it seems that this isn't the case - since so many logs reveil the opposite.
Please get this one out for 2008/Vista? It shouldn't have been an issue in the first place (like so many other issues with Vista).
Please get this one out for 2008 / Vista Written by Thomas Koetzing on 2008-10-13 08:56:43The 1.6d of UPHClean is build in to Vista/2008 (you even see the service notification when you logn to those system) and if you are still having Hive issues then report them to Microsoft.
Beta-Stadium Written by Jörg Radtke on 2008-11-05 11:20:49Hallo, gibt es eine Planung, wann die V2.x das Beta-Stadium verläßt?
Jörg Radtke
Beta-Stadium Written by Thomas Koetzing on 2008-11-05 11:18:57Der Entwickler hat inzwischen einen eigenen Blog (siehe Artikel) auch um solche Fragen zu stellen.
UPHClean und IMA Dienst Written by Roland U. on 2009-01-15 10:47:04Hallo. ich habe folgendes Problem. Bei Reboot des Servers (WIN2003 Std. & CTX 4.5) wird UPH Clean ausgeführt. Dieser Löscht jedoch den RSA Key und damit startet der IMA Dienst nicht mehr.
Frage: Wie kann ich den Ordner ausklammern damit er den RAS Key nicht mehr Löscht?
Danke für die Hilfe.
Gruß Roland U.
UPH Clean und IMA Dienst Written by Thomas Koetzing on 2009-01-15 10:45:25>Dieser Löscht jedoch den RSA Key UPHClean löscht keine Registry Keys und auch keine Dateien und schon gar nicht beim Start des Servers oder bei der Anmeldung des Benutzers!
UPHClean TRENNT lediglich Zugriffe auf die Registry des BENUTZERS oder dessen Dateien und NUR bei der Abmeldung des Benutzers und NUR wenn dies die Abmeldung negativ beeinflußt!
Written by Gast on 2009-04-08 12:31:47Hallo wir haben auch gesperrte Profile und konnten dies mit UPHClean nicht beheben. Bei uns scheint es ein Problem mit der ntuser.dat zu geben. Die ntuser.dat kann nicht mit regedit-'Struktur laden' geöffnet werden (Fehler beim Laden der Struktur). Auch eine Kopie von ntuser.dat kann nicht geöffnet werden. Nach reboot oder auf einen anderen Server kann ntuser.dat problemlos geladen werden. Nachdem ein paar Registry-Keys gekillt werden (z.B. Software\Microsoft\windows\current version\explorer\recentdocs\13 ) kann ntuser.dat ebenfalls geladen werden. Somit muss das System einzelne Keys in der ntuser.dat sperren. Gibt es API-Funktionen um eine derartige Sperre zuerkennen bzw. aufzuheben.
Beta 2.x ohne timing Problem Written by Thomas Koetzing on 2009-04-08 12:35:09>Hallo wir haben auch gesperrte Profile und >konnten dies mit UPHClean nicht beheben Version 1.6d hat u.u noch ein timing Problem und kann zu dem genanten Problem führen. Hier unbedingt die Beta 2.x testen.
Written by Gast on 2010-03-23 09:27:00Hallo,
ich hatte UPHClean 1.6 in einer 2000ner Umgebung im Einsatz und keine Probleme mehr seither gehabt.
Jetzt kommt ein riesiger Schritt auf Windows 7, mit einem Samba, ich habe jetzt die Beta im Einsatz, leider entläd sie das Profil nicht vollständig.
Kommt da für Win7 noch eine Verbesserung bzw. wird die Beta ewig bestehen bleiben? Ich finde Sommer 2005 ist jetzt schon eine ewig lange Zeit her, jetzt haben wir bald Sommer 2010.
MfG
End of live UPHClean Written by Thomas Koetzing on 2010-03-23 10:35:34Windows VISTA, Server 2008, Windows 7, Server 2008 R2 und folgende haben den UPHClean Service integriert. Bei Problemen an Microsoft wenden und ggf. Support Call aufmachen.
UPHClean 2.x wird nicht mehr weiter entwickelt!
miho007 Written by Gast on 2010-07-22 13:40:46Hallo,
mit der 2er Version habe ich mit dem Entladen der Profile fast keine Probleme. Nur bekomme ich diverse Meldungen das z.B. "Es konnten nicht alle Daten für die Datei ...Cookie\index.dat gespeichert werden. Das Profil wird aber sauber entfernt. Wo kommt diese Meldung her, wie kann man die abstellen?