Ver. 2023.3.3 - Updated WebView2 components

What is new in 2023.3.3:

  • Updated WebView2 components

Ver. 2023.3.2 - Included missing DLLs for WebLogon

What is new in 2023.3.2:

  • Included missing DLLs for WebLogon authentication (x64, x86, arm64)

Ver. 2023.3.1 - Improved processing of PowerQueries in Excel

What is new in 2023.3.1:

  • Improved processing of PowerQueries in Excel (recommended update if you have PowerQueries)

Ver. 2023.3 - SharePoint check of broken links and minor improvements

What is new in 2023.3:

  • Cleaned-up SharePoint relative shared links to exclude parts like /:x:/s/ for check of broken links.
  • Occasionally when you add SharePoint site, it will not be immediately visible in SharePoint treeview. Including additional text to explain workaround (close and re-open form with SharePoint treeview which will refresh entries):

Ver. 2023.2 - SharePoint throttling and ReplaceMagic - new functionality

What is new in 2023.2:

  • Fixed problem when on DFS share processing is stopping after first folder found with Access Denied permissions.
    As outside of ReplaceMagic components are used for creation of list of files for scanning, we cannot show skipped folders directly in ReplaceMagic but AccessDeniedLocations.log file will be created in c:\users\username\appdata\roaming\replacemagic\logs where you can find what was skipped. If no file is found that means that there were no locations with Access Denied. Failback location is c:\Temp.
  • Improved check of relative links with documents in SharePoint.
  • Extended filtering of temporary files (starting with ~$) uploaded to the SharePoint.
  • Added option to remove parameters from URL which is useful in case of migrations to SharePoint when there are URLs like: https://old.system.com/sites/newsitename/path/to/file/somefile.xlsx?d=w152a583596ef4cc198abe15ad350117d as after migration parameter d will point to old document ID which will not work anymore. To set parameters for removal use Configuration => Misc:

    What is new?
    With this configuration ReplaceMagic will remove d and p parameters from URL. Separator between parameters is | and this will work only for links in Hyperlinks section. Replacement is not case-sensitive so if you specify d=, ReplaceMagic will replace parameter d= but also D=.
    Prerequisite: you will need to provide search&replace strings as otherwise replacement process cannot start and changes in hyperlinks need to be selected.
  • Further reduction of requests to SharePoint to reduce workload triggered by ReplaceMagic.
  • Fixed bug that in rare cases under heavy throttling ReplaceMagic can close.
  • In SharePoint article https://learn.microsoft.com/en-us/sharepoint/dev/general-development/how-to-avoid-getting-throttled-or-blocked-in-sharepoint-online (last update from 03/20/2023; page is regularly updated) Microsoft is stating that beside user throttling there will be application throttling also. Every application will have own limits per tenant no mater if Microsoft Graph, CSOM or REST is used (ReplaceMagic is using CSOM and REST). Limits are as following (taken from MSFT site):

    Also different resource unit costs per request are defined:

    (example is for Microsoft Graph, where CSOM and REST are even more "expensive"). To translate to ReplaceMagic terminology - scanning is "easy" request as we need only to download file but in case of replacements multiple requests are required for:
    - Meta data preparation
    - Download file
    - Upload changed file
    - Optionally, set meta data back (last modification date, editor, status of file, version...)
    This will cause that replacement will require more than few request which will be taken from your quota. To reduce risk of throttling, we are strongly recommending not to use more than 2 documents in parallel (default is 4) as there will be great chance that you will be throttling. In case of throttling ReplaceMagic will automatically reduce parallelism to 1 (sequential processing) and if parameter Optimize workload is selected ReplaceMagic will start to increase parallelism after defined number of processed documents (new value 100 (reduced from 500) without throttling.
    According to Microsoft documentation, when throttling is happening there has to be used Retry-After parameter which will stop processing for SharePoint requested duration value.

  • Added parameter "Use SharePoint retry-after recommendation" - when SharePoint throttles you, it will send duration during which processing cannot continue. By using this parameter, ReplaceMagic will stop processing for SharePoint requested period and continue afterwards. Default: selected.

  • In case that you do not want to use SharePoint retry-after parameters values via parameter "Throttling retry-after period" you can define own wait period (default: 120). This parameter is only visible if parameter "Use SharePoint retry-after recommendation" is unchecked:

    Due to this parameter when ReplaceMagic is first time throttled, there will be pause of 120 seconds before processing can continue and you will see that information in progress bar. Using this and above parameter we are protecting your processing to be totally stopped and to have as less skipped documents due to throttling as possible.

 

Ver. 2023.1 - new WebView, multi language site support, name manager and more...

What is new:

  • WebLogon authentication used Microsoft Browser component to log or get logon data for SharePoint. As this component is based on Internet Explorer, it will start not work for SharePoint Modern sites logon as Microsoft is retiring Internet Explorer. To address this, we changed that ReplaceMagic is using new WebView2 component based on Chromium which supports modern sites also. 

    As this required installation of Microsoft WebView2 component, ReplaceMagic setup will trigger deployment if installation is not present.

    WebViev component will store cache in c:\users\username\appdata\roaming\replacemagic\EBWebView which might grow with the time. If this folder is deleted, you will need to login again. In case that command line is used, please ensure that you first login via ReplaceMagic interfaces as only then cache entries are present and logon will work without user interaction.
  • New parameter added to empty WebView2 cache on ReplaceMagic exist. Per default, parameter is not set.
  • Fixed bug that changes are not done in Text and Formulas in Excel files.
  • Name Manager - included that ReplaceMagic is not making changes of Name Manager links if they are longer than 235 characters to avoid hitting Excel limits as that will remove Name Manager links.
  • Name Manager - include processing only of Name Manager references which are visible in Excel (as there might be some hidden Name Manager references not visible to users)
  • Name Manager - as there might be a lot of name manager links which are mainly internal, per default, ReplaceMagic will not include them. In case that you expect external links in Name Manager links select option "Include Name Manager links".
    Expect that this will include a lot of link in Link Source section where majority (if not all) will be internal links that you can ignore.
  • Processing of huge documents (>250Mb) on SharePoint.Online - Per default SharePoint.Online does not allow upload of documents larger than 250 Mb which means that ReplaceMagic will report error and documents will not be changed. To allow huge documents upload, ReplaceMagic will split document in blocks of 245Mb allowing upload of any documents size (ok, there might be some other SharePoint.Online limits like maximum file size but this is different story). This will work only if you allow processing of larger documents (parameter in Configuration => Configuration => Skip files larger than) as per default ReplaceMagic is skipping documents larger than 100Mb.
    Constraints:
    • This will not work in case of App-Only authentication [beta]
    • In case that upload is, for any reason, interrupted before it is completed (all blocks), files will be damaged as only part of file is uploaded. Btw. same will happen also with any other tool uploading documents in blocks.
  • Added support for ReplacePreview mode for list item links.
  • Extended log file creation to include application version.
  • Changed setting name "Update Read Folder status" to "Refresh preparation status".
  • Extended "Refresh preparation status" to include progress bar updates when filtering documents.
  • Extended processing of FieldCodes of type FieldHyperlink and property Address and SubAddress.
  • As WebView cache can grow we added button to clear it manually.
  • Improved processing of multi language sites.
  • Improved PowerQueries processing.
  • New theme added: VS2022.

Ver. 2022.4 - support for Microsoft Information Protection and more...

What is new (2022.4):

  • Fixed replacement of SharePoint page hyperlinks containing in URL & - problem was that only first URL was changed
  • Web Logon authentication mode set as default for SharePoint login
  • Extended log capturing in case of SharePoint throttling
  • Fixed problem that SharePoint lists where name is starting after letter U were not visible
  • Convert spaces in link sources to %20 to mimic same way how Excel is saving them. This is important as that will have direct impact on link source length which was limit of 255 characters
  • Fixed Visio hyperlinks replacements bug that ExtraInfo (link part after ? is not saved). This was happening if initial link did not have ExtraInfo but new link has
  • ReplaceMagic now supports changes in Name Manager link. To do that select that changes should be in Link Sources which included Name Manager also
  • Extension of ReplaceMagic to support document encrypted by Microsoft Information Protection. Initial focus on Excel, Word and PowerPoint documents
  • For Microsoft Information Protection we need latest version of Microsoft Visual C++ Redistributable Visual Studio 2015, 2017, 2019, and 2022 (direct download link) which is also included in installation file
  • Fixed bug that PDF documents might stay checked-out after processing on SharePoint
  • Improved processing of data connections in Excel files
  • Further improvements of processing SharePoint Canvas pages
  • If SharePoint page has Canvas or Wiki content (page content stored in SharePoint database) changes of links there will have priority to hard-coded links. In general, there should not be hard-coded pages (page content not stored in SharePoint database)
  • Extended functionality that digitally signed documents (PDF, Excel, PowerPoint or Word) can be skipped during processing
 

 

Ver. 2022.3 - improved memory management, Excel formulas processing improvements

What is new in version 2022.3:

  • Memory management improved - memory leak found and fixed when having a lot of documents skipped due to timeout. 
    Comment: in case of skipped documents - findings from them (hyperlinks, OLE, LinkSources...) might appear in processing result grids as document processing was canceled after going through document structure. Unfortunately, there is no way to remove those results for the time being.
  • What is new (2022.3) Replacements in PDF documents simplified so there is only selection "Hyperlinks" instead "Hyperlinks" and "Launch Actions"
  • Previously, in case of major/minor enabled document libraries if active document was in major version ReplaceMagic was unpublishing it and then republishing. This is removed now in case if you set that you need versioning but Major or Minor version. In case that you need Keep Version Number unpublish will be still required as otherwise SharePoint will not allow change (error: Version conflict).
  • Maximum length of formulas was extended to 8192 characters. Changes where formula is longer than 8192 characters will be stopped to avoid document corruption. Side comment: to fix formula focus on Link Sources as after fixing Link Source(s) Excel will automatically update formulas.
  • Scanning documents export default option changed to most complete report
  • In rare cases, dependent on the tool used to create PDF documents, replacement in LinkAnnotation objects of PDF documents (hyperlinks) was making links unclickable which is fixed now.
 

 

Ver. 2022.2 - Further silent run improvements, keep last modified date in SharePoint...

What is new (2022.2)

  • Improved functionality to keep last modification date in case of changes in SharePoint. Focus on updates when SharePoint site having different time zone to user running ReplaceMagic
  • Extended command line run configuration that type of scanning can be also set (full scan results or ultra fast scan)










  • Extended import of skipped documents to show import progress
  • Fixed Link Sources check broken link counters for hidden Link Sources
  • Extended processing of SharePoint pages with hard coded text and regular expressions
  • Fix bug that changes in hard-coded SharePoint pages did not work properly

 

Ver. 2022.1 - Silent run improvements, SharePoint multi user and more...

New in version 2022.1 (16th of January, 2022)

  • Extended log file and Console view to report which document areas were selected for replacement process.
  • Extended that if ReplaceMagic is executed with silent run parameters file complete configuration is taken over so  if ReplaceMagic is used to process documents manually after silent run (for example, reprocessing of skipped documents) same parameters including search&replace strings are used.
  • Extended CommandLine parameters file with 2 undocumented parameters that can be added before closing XML tag </COMMANLINEPARAMETERS>:



    Those 2 parameters will overwrite document processing timeout parameters in ReplaceMagic configuration file and have to be added manually directly into silent run file.
  • If in form to add SharePoint site button Test was pressed and then form was closed pressing X in upper right corner, ReplaceMagic was showing error popup - problem resolved now.
  • In rare occasions, when multiple users are used to connect to the SharePoint, during document processing, SharePoint client context can be wrongly set causing that documents are skipped (they'll appear in Skipped Documents tabs where they can be reprocessed again. Error message will be something like "The object is used in the context different from the one associated with the object.").
  • Fixed problem that Power Queries in documents saved with non-English Excel are not recognized.
  • Fixed problem that Variation Labels list was not skipped in all scenarios.
  • Fixed problem that documents with extension in upper case were skipped.
  • Extended error tracking when creating list of documents in SharePoint (throttling, error 429 or 503)
  • Fixed bug that only one change in OneNote text area can be done.
  • Fixed bug "Enforce check-in [checked-out docs will be checked-in for processing]" stopped to work after 2021.3. Also changed option title to "Try to change checked-out document(s)"
  • Minimum .NET version changed to 4.7.2 as previously used 4.6.1 will be retired in May, 2022.
  • Fixed bug that in Ultra fast scan links of Quick Launch and Top Nav Bar were shown (time was spent on reading them).
  • Fixed bug that workload management (decrease/increase number of parallel documents for processing) did not work when throttling message did not contain (429) or (503).
  • In case that SharePoint DenyAddAndCustomizePages is enabled (meaning that you do not have permissions to make changes in SharePoint pages)



    ReplaceMagic will now report "Access denied (check ReplaceMagic help - Processing of SharePoint .aspx pages stopped working"):



    Previously ReplaceMagic will report problem to save page without conclusive explanation why.
  • If option "Remove Link Sources from Excel docs" is used (in Search & Replace configuration form) -> after removing external references formulas will be also updated in form => If formula was “=‘SomeExcelFile.xlam’!customfunction()”, after removing the external link “SomeExcelFile.xlam”, this cell’s formula will become “=customfunction().
  • Trial limitation and ReplacePreview mode - main trial limitation is that changes in 10% of scanned documents will be done. To get impression of complete replacement process from this version if you select "Replace Preview" option in Search&Replace form, during testing in trial mode, ReplaceMagic will report all changes in scanned documents according your entered search & replace strings. As this is Replace Preview mode no changes will be saved but you will get list of all what will be replaced in case that you purchase ReplaceMagic license.