commit | fdf3b9b5fbd76bceaaece3e3e39c1b16a581bf5e | [log] [tgz] |
---|---|---|
author | wenson_hsieh@apple.com <wenson_hsieh@apple.com@268f45cc-cd09-0410-ab3c-d52691b4dbfc> | Wed Jan 26 16:49:09 2022 +0000 |
committer | wenson_hsieh@apple.com <wenson_hsieh@apple.com@268f45cc-cd09-0410-ab3c-d52691b4dbfc> | Wed Jan 26 16:49:09 2022 +0000 |
tree | a64aeef4a9b59c78e8d148dbc5aada2622006edc | |
parent | 2f042e316806530ed8fdc590eab6bfece1409bcc [diff] |
Data detectors sometimes show up in the wrong place when resizing images with Live Text https://bugs.webkit.org/show_bug.cgi?id=235598 rdar://88032375 Reviewed by Dean Jackson. Source/WebCore: On macOS, Live Text data detectors sometimes show up in the wrong place when images are resized; this can happen in the case where image analysis injects data detection results into the image, but then the image is resized from underneath the user's mouse cursor. To fix this, add some logic to invalidate ImageOverlayController's cached data detector highlight information in the case where the image overlay layout has been changed. Test: fast/images/text-recognition/mac/image-overlay-data-detectors.html * WebCore.xcodeproj/project.pbxproj: Have libWebCoreTestSupport additionally link against libPAL, so that we can use PAL's DataDetectorsCore soft- linking utilities. * dom/ImageOverlay.cpp: (WebCore::ImageOverlay::updateSubtree): Drive-by fix in adjacent code: when installing image overlays in media elements, make sure that we install them inside the media controls root container by calling `ensureUserAgentShadowRoot()` before inserting the overlay content; this ensures that we don't end up with a redundant image overlay in the shadow root. Tests for this will be added in #235623. (WebCore::ImageOverlay::updateWithTextRecognitionResult): * page/ImageOverlayController.cpp: (WebCore::ImageOverlayController::textRecognitionResultsChanged): (WebCore::ImageOverlayController::hasActiveDataDetectorHighlightForTesting const): * page/ImageOverlayController.h: * page/mac/ImageOverlayControllerMac.mm: (WebCore::ImageOverlayController::textRecognitionResultsChanged): Add a hook to inform ImageOverlayController when image overlay content changes. If the image overlay host matches the currently active host element showing data detector highlights, then invalidate the highlights; these highlights will be recomputed once the user hovers over the data detector elements again. (WebCore::ImageOverlayController::hasActiveDataDetectorHighlightForTesting const): Add a testing-only helper method to query whether or not there is an active data detector highlight. See below for more details. * testing/Internals.cpp: Add some more WebCore testing support to make it possible to test data detector highlights in Live Text on macOS. (WebCore::makeDataForLine): (WebCore::Internals::installImageOverlay): Add an optional argument to provide a list of data detector quads to inject into the overlay host. For now, each data detector element simply corresponds to a dummy `DDScannerResult` returned by the static `fakeDataDetectorResultForTesting()` helper below. (WebCore::Internals::hasActiveDataDetectorHighlight const): Add an internal testing hook to query whether or not ImageOverlayController is tracking an active data detector highlight. * testing/Internals.h: * testing/Internals.idl: * testing/Internals.mm: (WebCore::Internals::fakeDataDetectorResultForTesting): Source/WebCore/PAL: Move some soft-linked DataDetectorsCore API out of the iOS-specific define, so that we can call them on macOS. See WebCore/ChangeLog for more details. * pal/cocoa/DataDetectorsCoreSoftLink.h: * pal/cocoa/DataDetectorsCoreSoftLink.mm: LayoutTests: Add a layout test to exercise (some) of the changes. This new layout test consists of 4 steps: 1. Hover over a data detector in Live Text and confirm that a data detector highlight is activated. 2. Resize the image (via script) such that the cursor is no longer over a data detector; confirm that the data detector highlight is cleared. 3. Move over the data detector highlight in the resized image, and confirm that the highlight is once again activated. 4. Move out of the image altogether and confirm that the highlight is deactivated. * fast/images/text-recognition/mac/image-overlay-data-detectors-expected.txt: Added. * fast/images/text-recognition/mac/image-overlay-data-detectors.html: Added. git-svn-id: http://svn.webkit.org/repository/webkit/trunk@288621 268f45cc-cd09-0410-ab3c-d52691b4dbfc
WebKit is a cross-platform web browser engine. On iOS and macOS, it powers Safari, Mail, iBooks, and many other applications.
Visit WebKit Feature Status page to see which Web API has been implemented, in development, or under consideration.
On macOS, download Safari Technology Preview to test the latest version of WebKit. On Linux, download Epiphany Technology Preview. On Windows, you'll have to build it yourself.
Once your bug is filed, you will receive email when it is updated at each stage in the bug life cycle. After the bug is considered fixed, you may be asked to download the latest nightly and confirm that the fix works for you.
On Windows, follow the instructions on our website.
Run the following command to clone WebKit's Git SVN repository:
git clone git@github.com:WebKit/WebKit.git WebKit
or
git clone https://github.com/WebKit/WebKit.git WebKit
If you want to be able to track Subversion revision from your git checkout, you can run the following command to do so:
Tools/Scripts/git-webkit setup-git-svn
For information about this, and other aspects of using Git with WebKit, read the wiki page.
If you don‘t want to use Git, run the following command to check out WebKit’s Subversion repository:
svn checkout https://svn.webkit.org/repository/webkit/trunk WebKit
Install Xcode and its command line tools if you haven't done so already:
xcode-select --install
Run the following command to build a debug build with debugging symbols and assertions:
Tools/Scripts/build-webkit --debug
For performance testing, and other purposes, use --release
instead.
You can open WebKit.xcworkspace
to build and debug WebKit within Xcode.
If you don't use a custom build location in Xcode preferences, you have to update the workspace settings to use WebKitBuild
directory. In menu bar, choose File > Workspace Settings, then click the Advanced button, select “Custom”, “Relative to Workspace”, and enter WebKitBuild
for both Products and Intermediates.
iOS, tvOS and watchOS are all considered embedded builds. The first time after you install a new Xcode, you will need to run:
sudo Tools/Scripts/configure-xcode-for-embedded-development
Without this step, you will see the error message: “target specifies product type ‘com.apple.product-type.tool’, but there’s no such product type for the ‘iphonesimulator’ platform.
” when building target JSCLLIntOffsetsExtractor
of project JavaScriptCore
.
Run the following command to build a debug build with debugging symbols and assertions for embedded simulators:
Tools/Scripts/build-webkit --debug --<platform>-simulator
or embedded devices:
Tools/Scripts/build-webkit --debug --<platform>-device
where platform
is ios
, tvos
or watchos
.
For production builds:
cmake -DPORT=GTK -DCMAKE_BUILD_TYPE=RelWithDebInfo -GNinja ninja sudo ninja install
For development builds:
Tools/gtk/install-dependencies Tools/Scripts/update-webkitgtk-libs Tools/Scripts/build-webkit --gtk --debug
For more information on building WebKitGTK+, see the wiki page.
For production builds:
cmake -DPORT=WPE -DCMAKE_BUILD_TYPE=RelWithDebInfo -GNinja ninja sudo ninja install
For development builds:
Tools/wpe/install-dependencies Tools/Scripts/update-webkitwpe-libs Tools/Scripts/build-webkit --wpe --debug
For building WebKit on Windows, see the wiki page.
Run the following command to launch Safari with your local build of WebKit:
Tools/Scripts/run-safari --debug
The run-safari
script sets the DYLD_FRAMEWORK_PATH
environment variable to point to your build products, and then launches /Applications/Safari.app
. DYLD_FRAMEWORK_PATH
tells the system loader to prefer your build products over the frameworks installed in /System/Library/Frameworks
.
To run other applications with your local build of WebKit, run the following command:
Tools/Scripts/run-webkit-app <application-path>
Run the following command to launch iOS simulator with your local build of WebKit:
run-safari --debug --ios-simulator
In both cases, if you have built release builds instead, use --release
instead of --debug
.
If you have a development build, you can use the run-minibrowser script, e.g.:
run-minibrowser --debug --wpe
Pass one of --gtk
, --jsc-only
, or --wpe
to indicate the port to use.
Congratulations! You’re up and running. Now you can begin coding in WebKit and contribute your fixes and new features to the project. For details on submitting your code to the project, read Contributing Code.