Ver. 2022.4 - support for Microsoft Information Protection and more...

What is new (2022.4):

  • Fixed replacement of SharePoint page hyperlinks containing in URL & - problem was that only first URL was changed
  • Web Logon authentication mode set as default for SharePoint login
  • Extended log capturing in case of SharePoint throttling
  • Fixed problem that SharePoint lists where name is starting after letter U were not visible
  • Convert spaces in link sources to %20 to mimic same way how Excel is saving them. This is important as that will have direct impact on link source length which was limit of 255 characters
  • Fixed Visio hyperlinks replacements bug that ExtraInfo (link part after ? is not saved). This was happening if initial link did not have ExtraInfo but new link has
  • ReplaceMagic now supports changes in Name Manager link. To do that select that changes should be in Link Sources which included Name Manager also
  • Extension of ReplaceMagic to support document encrypted by Microsoft Information Protection. Initial focus on Excel, Word and PowerPoint documents
  • For Microsoft Information Protection we need latest version of Microsoft Visual C++ Redistributable Visual Studio 2015, 2017, 2019, and 2022 (direct download link) which is also included in installation file
  • Fixed bug that PDF documents might stay checked-out after processing on SharePoint
  • Improved processing of data connections in Excel files
  • Further improvements of processing SharePoint Canvas pages
  • If SharePoint page has Canvas or Wiki content (page content stored in SharePoint database) changes of links there will have priority to hard-coded links. In general, there should not be hard-coded pages (page content not stored in SharePoint database)
  • Extended functionality that digitally signed documents (PDF, Excel, PowerPoint or Word) can be skipped during processing
 

 

Ver. 2022.3 - improved memory management, Excel formulas processing improvements

What is new in version 2022.3:

  • Memory management improved - memory leak found and fixed when having a lot of documents skipped due to timeout. 
    Comment: in case of skipped documents - findings from them (hyperlinks, OLE, LinkSources...) might appear in processing result grids as document processing was canceled after going through document structure. Unfortunately, there is no way to remove those results for the time being.
  • What is new (2022.3) Replacements in PDF documents simplified so there is only selection "Hyperlinks" instead "Hyperlinks" and "Launch Actions"
  • Previously, in case of major/minor enabled document libraries if active document was in major version ReplaceMagic was unpublishing it and then republishing. This is removed now in case if you set that you need versioning but Major or Minor version. In case that you need Keep Version Number unpublish will be still required as otherwise SharePoint will not allow change (error: Version conflict).
  • Maximum length of formulas was extended to 8192 characters. Changes where formula is longer than 8192 characters will be stopped to avoid document corruption. Side comment: to fix formula focus on Link Sources as after fixing Link Source(s) Excel will automatically update formulas.
  • Scanning documents export default option changed to most complete report
  • In rare cases, dependent on the tool used to create PDF documents, replacement in LinkAnnotation objects of PDF documents (hyperlinks) was making links unclickable which is fixed now.
 

 

Ver. 2022.2 - Further silent run improvements, keep last modified date in SharePoint...

What is new (2022.2)

  • Improved functionality to keep last modification date in case of changes in SharePoint. Focus on updates when SharePoint site having different time zone to user running ReplaceMagic
  • Extended command line run configuration that type of scanning can be also set (full scan results or ultra fast scan)










  • Extended import of skipped documents to show import progress
  • Fixed Link Sources check broken link counters for hidden Link Sources
  • Extended processing of SharePoint pages with hard coded text and regular expressions
  • Fix bug that changes in hard-coded SharePoint pages did not work properly

 

Ver. 2022.1 - Silent run improvements, SharePoint multi user and more...

New in version 2022.1 (16th of January, 2022)

  • Extended log file and Console view to report which document areas were selected for replacement process.
  • Extended that if ReplaceMagic is executed with silent run parameters file complete configuration is taken over so  if ReplaceMagic is used to process documents manually after silent run (for example, reprocessing of skipped documents) same parameters including search&replace strings are used.
  • Extended CommandLine parameters file with 2 undocumented parameters that can be added before closing XML tag </COMMANLINEPARAMETERS>:



    Those 2 parameters will overwrite document processing timeout parameters in ReplaceMagic configuration file and have to be added manually directly into silent run file.
  • If in form to add SharePoint site button Test was pressed and then form was closed pressing X in upper right corner, ReplaceMagic was showing error popup - problem resolved now.
  • In rare occasions, when multiple users are used to connect to the SharePoint, during document processing, SharePoint client context can be wrongly set causing that documents are skipped (they'll appear in Skipped Documents tabs where they can be reprocessed again. Error message will be something like "The object is used in the context different from the one associated with the object.").
  • Fixed problem that Power Queries in documents saved with non-English Excel are not recognized.
  • Fixed problem that Variation Labels list was not skipped in all scenarios.
  • Fixed problem that documents with extension in upper case were skipped.
  • Extended error tracking when creating list of documents in SharePoint (throttling, error 429 or 503)
  • Fixed bug that only one change in OneNote text area can be done.
  • Fixed bug "Enforce check-in [checked-out docs will be checked-in for processing]" stopped to work after 2021.3. Also changed option title to "Try to change checked-out document(s)"
  • Minimum .NET version changed to 4.7.2 as previously used 4.6.1 will be retired in May, 2022.
  • Fixed bug that in Ultra fast scan links of Quick Launch and Top Nav Bar were shown (time was spent on reading them).
  • Fixed bug that workload management (decrease/increase number of parallel documents for processing) did not work when throttling message did not contain (429) or (503).
  • In case that SharePoint DenyAddAndCustomizePages is enabled (meaning that you do not have permissions to make changes in SharePoint pages)



    ReplaceMagic will now report "Access denied (check ReplaceMagic help - Processing of SharePoint .aspx pages stopped working"):



    Previously ReplaceMagic will report problem to save page without conclusive explanation why.
  • If option "Remove Link Sources from Excel docs" is used (in Search & Replace configuration form) -> after removing external references formulas will be also updated in form => If formula was “=‘SomeExcelFile.xlam’!customfunction()”, after removing the external link “SomeExcelFile.xlam”, this cell’s formula will become “=customfunction().
  • Trial limitation and ReplacePreview mode - main trial limitation is that changes in 10% of scanned documents will be done. To get impression of complete replacement process from this version if you select "Replace Preview" option in Search&Replace form, during testing in trial mode, ReplaceMagic will report all changes in scanned documents according your entered search & replace strings. As this is Replace Preview mode no changes will be saved but you will get list of all what will be replaced in case that you purchase ReplaceMagic license. 

Ver. 2021.5 - Remove link sources, improved processing of SharePoint pages...

New in version 2021.5

  • Added option that ReplaceMagic removes all link sources from your Excel documents:
  • What is new (2021.5)?
     
    Extended command line run to include filtering of files based on dates:

  • Changed that per default ReplaceMagic will not check-out/check-in documents when processing files on SharePoint. Reason is that if this is done and there is SharePoint throttling which will cause that files are skipped, documents might stay checked-out. In case that you want to to keep publishing or approval status you will need to have this feature enabled.
  • Fixed bug that after SharePoint pages replacements are done published pages are staying in unpublished state (minor version).
  • Sorting of search & replace strings - As sort order of search&replace strings is very import ReplaceMagic will now sort them automatically according to their length descending when you press button to start replacement process or to prepare parameters for command line run. This is required as if you have shorter strings first ReplaceMagic might make changes when shorter string is found and as it is also part of longer search string that might cause that longer string is skipped as changes are already done. This is done in the background to ensure that strings are properly sorted but sort order will not be visible in search and replace form.
    As a indicator, we added new column "Search length" which can be used as indicator to show length of your search strings
  • Extended ReplaceMagic to automatically take care of approval and/or publishing status of documents stored in SharePoint when this setup is used. Previously, user had to select what ReplaceMagic should do.

Ver. 2021.4 - SharePoint pages, special characters and more...

New in version 2021.4

  • There is a chance that Link Sources in Excel files are not visible if you go to Data=>Connection=>Edit Links but that they are still present if you check XML document structure - to support analyses on this side ReplaceMagic will include in Link Source tab additional field called VisibleInExcel which will help to better understand structure of link source stored in documents.
    In case that this field is not visible go to c:\users\username\appdata\roaming\replacemagic or c:\users\username\appdata\local\replacemagic and delete file gridLinkSourcesLayout.xml which will reset result grid fields (btw. this will show default fields order).
  • Added option that ReplaceMagic during replacements in hyperlinks, OLE, Link Sources, Pivot or Power Queries makes replacement of special characters. This is useful in case of documents stored in SharePoint as some migration tools are converting locations of copied documents by replacing special characters.

    Option "Use illegal characters conversion during check of broken links?" will instruct ReplaceMagic to replace special characters when links are checked. This will not make any changes of links.

    Option "Replace SharePoint illegal characters?" will instruct ReplaceMagic to convert illegal characters during replacement process similar to conversion of /and \.

    Special characters are converted in order from 1 to 18 and empty fields are skipped.
  • Extended processing of SharePoint .aspx page where content is part directly of the page. ReplaceMagic will read all tags used in .aspx page and make replacement of them. Previously, only content between <mso:PublishingPageContent></mso:PublishingPageContent> was processed (default SharePoint pages).
  • Fixed bug that silent run processing replacement process did not work.
  • Added parameter to control if ReplaceMagic will automatically close after silent run processing is finished.
  • Fixed bug that when document processing timeout was reached number of active threads was not reduced after closing processed document which could lead that processing is stopped waiting on free processes.
  • Changed that ReplaceMagic in command line mode is closing splash screen before processing documents.

Error - Sorry we can't get to your account right now. To fix this please sign in again. => resolved

This time something different :)

For some reason since weeks I had problem to connect to O365 mailbox. Initially, it stopped work so I decided to remove mailbox from Outlook (2016) and to add it again but that did not work. For whatever reasons, no matter, what I tried Outlook was not able to connect to O365.

Yesterday, it started to be even worse as when I went to SharePoint Online to test processing of documents all was ok and when I tried to open documents in Excel Online that worked too but opening of files through normal version of Excel was not working.

Surprisingly, Excel was telling me that I am already logged from some other machine which was not the case and additionally any Office desktop application was showing error next to username.

By opening this I saw: "Error - Sorry we can't get to your account right now. To fix this please sign in again." and logically, I tried to sign in again but that did not work so I was thinking "great, now beside Outlook, rest of Office apps are not working".

Of course, I did sign-out and then again sign-in but no progress. I even checked my user account under Windows Settings => Access work or school but that did not help.

Ultimately, solution was to go to Office app (I tried Excel) and to sign-out and then to go to Windows Settings => Access work or school where I clicked on Disconnect below my O365 account. After doing restart (not sure if this is really needed) I went to Excel and this time I logged again without any warnings and then I tried to add again my O365 account to Outlook 2016 and that worked.

 

Ver. 2021.3 - SharePoint processing improvements and more...

What is new in ReplaceMagic 2021.3:

  • SharePoint Online throttling - Recently, we noticed that Microsoft is even more protecting SharePoint Online platform by slowing down processing of documents.
    As during scanning and replacements ReplaceMagic needs to download documents, read document meta data, apply check-in/check-out settings, keep status of documents (approval, publishing) and finally to upload documents and set all meta data back to normal you can see performance degradation. To avoid this move document processing outside of business hours and do not over parallelize processing of documents as otherwise duration of processing can be impacted. Of course, we will try to protect processing but throttling, which is normal to expect, is, unfortunately, outside of our hands.

    Additional infos can be found in article SharePoint Throttling

    In case of skipped documents during replacement phase - Due to those limitations some documents might be skipped but ReplaceMagic offers option to import skipped files and process them after main replacement phase is done. To do that, in newly, shown tab Additional Info click on:



    This can be repeated until not all documents are not processed.

    We would also recommend to split processing on few smaller batches/locations to avoid having processing against large collection of documents at once.
  • SharePoint performance metrics changed to show average processing time per document as previously ReplaceMagic was showing total phase processing time. Average processing time is calculated as total phase time / total processed documents. Those metrics are part of result dashboards.
  • SharePoint Web Logon- sometimes Web Logon authentication might take longer. If this is taking more than 30+ in newly opened popup click on button:

    In case that SharePoint structure is not shown in main SharePoint form please close it and open it again (we are working on this rare refresh problem).
  • Added functionality to create Windows registry entries for creation of Windows dumps if ReplaceMagic is crashing. This can be done over Configuration => Logs

    This will work only if your user has enough Windows permissions.
    Dump files are required for root-cause analyses by ReplaceMagic team and per default they will be stored in C:\Users\USERNAME\Local\ReplaceMagic\CrashDumps.
    Depending on your Windows policies this might not work but we recommend set it anyway.
    IMPORTANT: Do this only on request for ReplaceMagic team
  • Fix bug that in some cases documents on local locations (disks, file servers,...) were skipped.
    Check only XML stored Link Sources - Excel link sources are stored in XML structure under /xl/externalLinks/_rels location but during check if links are broken ReplaceMagic will read this location but also location which is used in Excel if you go to Data => Edit links. To avoid false-positive results, we include feature to disable check of link which is shown in Excel:

    Per default we are checking both location and if one is working ReplaceMagic will report that link is ok.
  • In case that Excel document is moved to new location hard-coded AbsolutePath value will still point to the old location. Absolute path value is used to show link sources if you open Excel document and go to Data => Edit Link. From this version, in case that there are Link Source changes ReplaceMagic will update Absolute Link to point to new location where documents is. This means, when you open Excel file and go to Data => Edit Links you will see link pointing to some URL or drive/network location like where document is stored.
    Fixed bug that was triggering "expired maintenance" when maintenance was still valid.
    "Native SharePoint check of broken links" - extended support for additional case of hyperlinks in list items (field of URL type). Keep in mind that this feature will send additional requests to SharePoint what might increase risk to get throttled by SharePoint.
    Added new tab under Configuration for misc features - "Convert relative to absolute links"  used to define how relative links will be checked. Per default when ReplaceMagic finds relative link, it will merge that link and location of file containing this link which might be misleading in some cases. With this feature you can specify how link should start and what should be prefix but also if slashes has to be converted:

    Additionally, ReplaceMagic can write to log file original address and also address where prefix was added for your reference.
    Keep in that this will have performance impact as due to, probably, large number of links ReplaceMagic will need to write a lot to log files. Of course, this is only active during scanning process.

    Remark: original links will not be impacted by this as this change is used only for check of links without making real changes.
  • Started to add functionality to process SharePoint Quick Launch and Top Menu Bar.

    IMPORTANT: In case that SharePoint cannot recognize new menu link as valid, change will not be saved. Keep in mind that you have to convert menu link to valid link.
    Log files should be now created after any of processing activities (scanning documents or replacement process). Log files are per default saved in c:\users\username\appdata\roaming\replacemagic\logs or in c:\users\username\appdata\local\replacemagic\logs and filename format is: ReplaceMagic - Datum - Time.log (for example,  ReplaceMagic - 13.05.2021 135259.log)
    Fix bug that scanning of .aspx pages (in SharePoint) was reporting more links than pages really have.
    Added encoding/decoding of additional special characters in .aspx pages.
    Extended convert slash/backslash functionality to changes in Excel text area (convert functionality will be applied only on changed cell content).
    Formatting of SharePoint labels in scanning or replacement dashboard adjusted => (SP) moved to second row.
  • Added parameter "Fast Calendar Step" which can be used to set how many months ReplaceMagic calendar will move to the left or right when << or >> are pressed:

  • Added option that ReplaceMagic converts Unicode characters in SharePoint/Web pages:

Ver. 2021.2.1 - SharePoint pages replacement results fix

What is new in ReplaceMagic 2021.2.1:

  • Fixed bug that replacements in SharePoint Wiki or SharePoint Canvas pages are done but not reported in result lists

Ver. 2021.2 - multi user support for SharePoint Online to reduce throttling risk...

What is new in ReplaceMagic 2021.2:

  • New theme added => Office2019Light
  • Fixed bug during processing of SharePoint .aspx pages that no changes are done as encoded : (&#58;) was not properly converted to : leading that no changes of strings containing : were done.
  • Fixed bug (introduced in 2020.12.1) that changes in Canvas and Wiki pages did not work.
  • In case that there is problem during startup of ReplaceMagic new log file ReplaceMagicStartup.log will be created providing information what happened.
  • Added feature to create multiple SharePoint users which will be used to process documents in round-robin model (every document will use next SharePoint user from created list of users). This might be interesting in case of SharePoint throttling as in this case it will look like that there are multiple users accessing and processing documents stored on SharePoint.
  • In case of multi language sites, if ReplaceMagic user is having different language to language used to create site selected for processing, ReplaceMagic was stopping complete processing (probably in progress bar you could see message "Root prepared...)". From this version there is additional notification if something like this happens telling you that you'll need to align user and site language. Of course, additional logging is also provided in Console View or in ReplaceMagic log file.
  • Fixed bug that password protected documents stored on SharePoint, after password was provided, were not processed.
  • Check of broken links when documents are stored on SharePoint might end-up with errors like 403 Forbidden. To avoid that we are introducing parameter "Native SharePoint check of broken links" which will allow ReplaceMagic to use SharePoint object model to check if links are broken or not. Unfortunately, this means that for each of found links ReplaceMagic will send request to link location which will be very "expensive" meaning that processing performances will suffer and there is high risk that, due to high number of SharePoint requests, Microsoft throttle complete processing. Nevertheless, as some customers shown interest in this feature it is included now but you are solely responsible for usage of it thus warning message.
  • Improved error handling when test email sending is triggered from Configuration => Notification