New in version 2023.5 (recommended upgrade)
- Improved processing of files with special characters like % and #.
Until this version this was possible only when legacy SharePoint mode was used. From this version this will work also when legacy mode is not selected. Previously, ReplaceMagic would report:
"File with % in name cannot be saved; if possible switch to SharePoint Legacy mode"
- Fixed bug in parameter removal functionality (parameter was removed but link was not updated)
- Further optimizations in processing Excel files (LinkSources...)
What is new:
- Fixed bug that during processing documents stored non-SharePoint location number of working processes is reduced due to SharePoint throttling mitigation actions.
- Fixed bug that in rare case scanning results are not shown due to wrong counter of active threads.
What is new in 2023.3.3:
- Updated WebView2 components
What is new in 2023.3.2:
- Included missing DLLs for WebLogon authentication (x64, x86, arm64)
What is new in 2023.3.1:
- Improved processing of PowerQueries in Excel (recommended update if you have PowerQueries)
What is new in 2023.3:
- Cleaned-up SharePoint relative shared links to exclude parts like /:x:/s/ for check of broken links.
- Occasionally when you add SharePoint site, it will not be immediately visible in SharePoint treeview. Including additional text to explain workaround (close and re-open form with SharePoint treeview which will refresh entries):
What is new in 2023.2:
- Fixed problem when on DFS share processing is stopping after first folder found with Access Denied permissions.
As outside of ReplaceMagic components are used for creation of list of files for scanning, we cannot show skipped folders directly in ReplaceMagic but AccessDeniedLocations.log file will be created in c:\users\username\appdata\roaming\replacemagic\logs where you can find what was skipped. If no file is found that means that there were no locations with Access Denied. Failback location is c:\Temp.
- Improved check of relative links with documents in SharePoint.
- Extended filtering of temporary files (starting with ~$) uploaded to the SharePoint.
- Added option to remove parameters from URL which is useful in case of migrations to SharePoint when there are URLs like: https://old.system.com/sites/newsitename/path/to/file/somefile.xlsx?d=w152a583596ef4cc198abe15ad350117d as after migration parameter d will point to old document ID which will not work anymore. To set parameters for removal use Configuration => Misc:
What is new?
With this configuration ReplaceMagic will remove d and p parameters from URL. Separator between parameters is | and this will work only for links in Hyperlinks section. Replacement is not case-sensitive so if you specify d=, ReplaceMagic will replace parameter d= but also D=.
Prerequisite: you will need to provide search&replace strings as otherwise replacement process cannot start and changes in hyperlinks need to be selected.
- Further reduction of requests to SharePoint to reduce workload triggered by ReplaceMagic.
- Fixed bug that in rare cases under heavy throttling ReplaceMagic can close.
- In SharePoint article https://learn.microsoft.com/en-us/sharepoint/dev/general-development/how-to-avoid-getting-throttled-or-blocked-in-sharepoint-online (last update from 03/20/2023; page is regularly updated) Microsoft is stating that beside user throttling there will be application throttling also. Every application will have own limits per tenant no mater if Microsoft Graph, CSOM or REST is used (ReplaceMagic is using CSOM and REST). Limits are as following (taken from MSFT site):
Also different resource unit costs per request are defined:
(example is for Microsoft Graph, where CSOM and REST are even more "expensive"). To translate to ReplaceMagic terminology - scanning is "easy" request as we need only to download file but in case of replacements multiple requests are required for:
- Meta data preparation
- Download file
- Upload changed file
- Optionally, set meta data back (last modification date, editor, status of file, version...)
This will cause that replacement will require more than few request which will be taken from your quota. To reduce risk of throttling, we are strongly recommending not to use more than 2 documents in parallel (default is 4) as there will be great chance that you will be throttling. In case of throttling ReplaceMagic will automatically reduce parallelism to 1 (sequential processing) and if parameter Optimize workload is selected ReplaceMagic will start to increase parallelism after defined number of processed documents (new value 100 (reduced from 500) without throttling.
According to Microsoft documentation, when throttling is happening there has to be used Retry-After parameter which will stop processing for SharePoint requested duration value.
- Added parameter "Use SharePoint retry-after recommendation" - when SharePoint throttles you, it will send duration during which processing cannot continue. By using this parameter, ReplaceMagic will stop processing for SharePoint requested period and continue afterwards. Default: selected.
- In case that you do not want to use SharePoint retry-after parameters values via parameter "Throttling retry-after period" you can define own wait period (default: 120). This parameter is only visible if parameter "Use SharePoint retry-after recommendation" is unchecked:
Due to this parameter when ReplaceMagic is first time throttled, there will be pause of 120 seconds before processing can continue and you will see that information in progress bar. Using this and above parameter we are protecting your processing to be totally stopped and to have as less skipped documents due to throttling as possible.
What is new:
- WebLogon authentication used Microsoft Browser component to log or get logon data for SharePoint. As this component is based on Internet Explorer, it will start not work for SharePoint Modern sites logon as Microsoft is retiring Internet Explorer. To address this, we changed that ReplaceMagic is using new WebView2 component based on Chromium which supports modern sites also.
As this required installation of Microsoft WebView2 component, ReplaceMagic setup will trigger deployment if installation is not present.
WebViev component will store cache in c:\users\username\appdata\roaming\replacemagic\EBWebView which might grow with the time. If this folder is deleted, you will need to login again. In case that command line is used, please ensure that you first login via ReplaceMagic interfaces as only then cache entries are present and logon will work without user interaction.
- New parameter added to empty WebView2 cache on ReplaceMagic exist. Per default, parameter is not set.
- Fixed bug that changes are not done in Text and Formulas in Excel files.
- Name Manager - included that ReplaceMagic is not making changes of Name Manager links if they are longer than 235 characters to avoid hitting Excel limits as that will remove Name Manager links.
- Name Manager - include processing only of Name Manager references which are visible in Excel (as there might be some hidden Name Manager references not visible to users)
- Name Manager - as there might be a lot of name manager links which are mainly internal, per default, ReplaceMagic will not include them. In case that you expect external links in Name Manager links select option "Include Name Manager links".
Expect that this will include a lot of link in Link Source section where majority (if not all) will be internal links that you can ignore.
- Processing of huge documents (>250Mb) on SharePoint.Online - Per default SharePoint.Online does not allow upload of documents larger than 250 Mb which means that ReplaceMagic will report error and documents will not be changed. To allow huge documents upload, ReplaceMagic will split document in blocks of 245Mb allowing upload of any documents size (ok, there might be some other SharePoint.Online limits like maximum file size but this is different story). This will work only if you allow processing of larger documents (parameter in Configuration => Configuration => Skip files larger than) as per default ReplaceMagic is skipping documents larger than 100Mb.
Constraints:
- This will not work in case of App-Only authentication [beta]
- In case that upload is, for any reason, interrupted before it is completed (all blocks), files will be damaged as only part of file is uploaded. Btw. same will happen also with any other tool uploading documents in blocks.
- Added support for ReplacePreview mode for list item links.
- Extended log file creation to include application version.
- Changed setting name "Update Read Folder status" to "Refresh preparation status".
- Extended "Refresh preparation status" to include progress bar updates when filtering documents.
- Extended processing of FieldCodes of type FieldHyperlink and property Address and SubAddress.
- As WebView cache can grow we added button to clear it manually.
- Improved processing of multi language sites.
- Improved PowerQueries processing.
- New theme added: VS2022.
What is new (2022.4):
- Fixed replacement of SharePoint page hyperlinks containing in URL & - problem was that only first URL was changed
- Web Logon authentication mode set as default for SharePoint login
- Extended log capturing in case of SharePoint throttling
- Fixed problem that SharePoint lists where name is starting after letter U were not visible
- Convert spaces in link sources to %20 to mimic same way how Excel is saving them. This is important as that will have direct impact on link source length which was limit of 255 characters
- Fixed Visio hyperlinks replacements bug that ExtraInfo (link part after ? is not saved). This was happening if initial link did not have ExtraInfo but new link has
- ReplaceMagic now supports changes in Name Manager link. To do that select that changes should be in Link Sources which included Name Manager also
- Extension of ReplaceMagic to support document encrypted by Microsoft Information Protection. Initial focus on Excel, Word and PowerPoint documents
- For Microsoft Information Protection we need latest version of Microsoft Visual C++ Redistributable Visual Studio 2015, 2017, 2019, and 2022 (direct download link) which is also included in installation file
- Fixed bug that PDF documents might stay checked-out after processing on SharePoint
- Improved processing of data connections in Excel files
- Further improvements of processing SharePoint Canvas pages
- If SharePoint page has Canvas or Wiki content (page content stored in SharePoint database) changes of links there will have priority to hard-coded links. In general, there should not be hard-coded pages (page content not stored in SharePoint database)
- Extended functionality that digitally signed documents (PDF, Excel, PowerPoint or Word) can be skipped during processing
What is new in version 2022.3:
- Memory management improved - memory leak found and fixed when having a lot of documents skipped due to timeout.
Comment: in case of skipped documents - findings from them (hyperlinks, OLE, LinkSources...) might appear in processing result grids as document processing was canceled after going through document structure. Unfortunately, there is no way to remove those results for the time being.
- What is new (2022.3) Replacements in PDF documents simplified so there is only selection "Hyperlinks" instead "Hyperlinks" and "Launch Actions"
- Previously, in case of major/minor enabled document libraries if active document was in major version ReplaceMagic was unpublishing it and then republishing. This is removed now in case if you set that you need versioning but Major or Minor version. In case that you need Keep Version Number unpublish will be still required as otherwise SharePoint will not allow change (error: Version conflict).
- Maximum length of formulas was extended to 8192 characters. Changes where formula is longer than 8192 characters will be stopped to avoid document corruption. Side comment: to fix formula focus on Link Sources as after fixing Link Source(s) Excel will automatically update formulas.
- Scanning documents export default option changed to most complete report
- In rare cases, dependent on the tool used to create PDF documents, replacement in LinkAnnotation objects of PDF documents (hyperlinks) was making links unclickable which is fixed now.