Future Apple Pencil Could Have Sensor to Sample Colors From the Real World

Apple is exploring new Apple Pencil technology that could allow the device to sample colors from the real world to use in digital art, drawings, edits, and more, according to an Apple patent application published by the United States Patent and Trademark Office this week.

Apple Pencil Color Picker
Titled "Computer System With Color Sampling Stylus," the patent describes a computer stylus that "may have a color sensor."

The color sensor would be equipped with several photodetectors able to measure light for different color channels, which would let it detect and sample a color from a real world object, like a flower.

The stylus could also be equipped with a light to make it easier for the photodetectors to accurately determine a color, and the rest of the patent describes an Apple Pencil-like design with an elongated body, a tip, and an opposing end, with the tip able to work with a touch-sensitive display.

Apple says the color sensor functionality could be located at the end of the stylus, at the tip, or coupled to the tip through a light guide.

applepatentcolorsensor
With this kind of technology, ‌Apple Pencil‌ users would be able to do something like hold the ‌Apple Pencil‌ against an object in the real world, with the ‌Apple Pencil‌ reading the color. It could be used for photorealistic paintings or just sampling of unique colors from grass, plants, existing art, and so much more.

According to the patent, the stylus would detect the color and then put it in a color palette in a drawing program, where the color could be assigned to a brush. Apple also suggests that color sensor could perhaps be used for other purposes such as calibrating displays, calibrating printers, making health-related measurements, and identifying paint colors for home projects, which would make the ‌Apple Pencil‌ even more versatile.

Optical color sensors like this already exist and have been used in various ways. In fact, we've tested a simple, rudimentary optical color sensor in the Sphero Specdrums, a product meant to turn color into sound. This product includes a little finger ring that can be tapped against real world objects to make sounds based on the color it senses, but Apple's implementation would presumably be much more precise.

Apple patents all kinds of different technologies, some of which seem plausible to implement and others that are quite fantastical. There's never any guarantee that Apple's patents will be used for real products, and in fact, most patents are for technologies that never get released.

For that reason, there's no word on whether Apple actually plans to add a color sensor to the ‌Apple Pencil‌, or if this is simply an idea that's never going to make it out of the possibilities phase.

Related Forum: iPad Accessories

Top Rated Comments

SamGabbay Avatar
48 months ago
Now that's freaking awesome.
Score: 49 Votes (Like | Disagree)
AngerDanger Avatar
48 months ago

can't wait to try it with a chameleon... ?
I can do you one better, mate…



Attachment Image
Score: 48 Votes (Like | Disagree)
UltimateSyn Avatar
48 months ago

can't wait to try it with a chameleon... ?
Error 404: Color Not Found
Score: 28 Votes (Like | Disagree)
yaxomoxay Avatar
48 months ago
can't wait to try it with a chameleon... ?
Score: 22 Votes (Like | Disagree)
nfl46 Avatar
48 months ago
I gotta admit: that’s pretty cool.
Score: 21 Votes (Like | Disagree)
Doctor Q Avatar
48 months ago
This feature could be especially helpful for color blind users like me. Since I can't identify most colors visually, I do a lot sampling/copying/pasting of colors, or looking them up and specifying them by their RGB values. Being able to grab a color and digitize it physically would be super useful.
Score: 18 Votes (Like | Disagree)

Popular Stories

iPhone Home Screen Gradient Blank Spaces 1

Sources: iOS 18 Lets Apps Be Placed Anywhere on Home Screen Grid

Sunday March 24, 2024 1:33 pm PDT by
iOS 18 will give iPhone users greater control over Home Screen app icon arrangement, according to sources familiar with the matter. While app icons will likely remain locked to an invisible grid system on the Home Screen, to ensure there is some uniformity, our sources say that users will be able to arrange icons more freely on iOS 18. For example, we expect that the update will introduce...
iPad Pro 2024 Landscape Camera Feature

New iPad Pro Again Rumored to Feature Landscape Front-Facing Camera

Monday March 25, 2024 5:43 am PDT by
The next-generation iPad Pro will feature a landscape-oriented front-facing camera for the first time, according to the Apple leaker known as "Instant Digital." Instant Digital reiterated the design change earlier today on Weibo with a simple accompanying 2D image. The post reveals that the entire TrueDepth camera array will move to the right side of the device, while the microphone will...
sonoma desktop wwdc

Apple Releases macOS Sonoma 14.4.1 With Fix for USB Hub Bug

Monday March 25, 2024 10:10 am PDT by
Apple today released macOS Sonoma 14.4.1, a minor update for the macOS Sonoma operating system that launched last September. macOS Sonoma 14.4.1 comes three weeks after macOS Sonoma 14.4. The ‌‌‌‌macOS Sonoma‌‌ 14.4‌.1 update can be downloaded for free on all eligible Macs using the Software Update section of System Settings. There's also a macOS 13.6.6 release for those who...
iPhone 15 General Feature Green

Apple Says These New iOS Features Are Coming Later This Year

Sunday March 24, 2024 7:45 am PDT by
Apple has previously announced three new iOS features that it said are coming to the iPhone later this year, as outlined below. The new features include the ability to install iPhone apps on the web in the EU, RCS support in the Messages app, and next-generation CarPlay. Web Distribution Apple recently announced that eligible developers will soon be able to distribute their iOS apps to ...
Beyond iPhone 13 Better Blue Face ID Single Camera Hole

Seven Reasons to Wait for Next Year's iPhone 17

Tuesday March 19, 2024 5:20 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models concurrently, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different, and already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
maxresdefault

iOS 18 Rumored to Feature 'More Customizable' Home Screen

Sunday March 24, 2024 7:10 am PDT by
iOS 18 will feature a revamped Home Screen that is "more customizable," according to Bloomberg's Mark Gurman. He revealed this information in his Power On newsletter today, but he did not provide any specific details. Subscribe to the MacRumors YouTube channel for more videos. Apple will announce iOS 18 at its annual developers conference WWDC in June. Other features and changes rumored for...
combine images

Top Stories: iOS 18's Generative AI Features to Rely on Google?, Latest on New iPads, and More

Saturday March 23, 2024 6:00 am PDT by
We're getting closer to the launch of new iPad Pro and iPad Air models, while rumors about iOS 18 are continuing to ramp up with this week's surprise revelation that Apple has been talking to Google and others about potentially helping power the generative AI features expected to be a major part of this year's update. Other news this week saw the release of iOS 17.4.1 and iPadOS 17.4.1...