← Back to AI Insights
Gemini Executive Synthesis

AI agent text input (`phone_type`) on iOS 27, specifically into non-password fields like Apple Notes body.

Technical Positioning
Ensuring secure and reliable text input for AI agents across various iOS applications, without false positives for credential fields.
SaaS Insight & Market Implications
This issue reveals a critical false positive in AI agent security policy on iOS 27: `phone_type` is blocked by a 'credentials' rule when attempting to input text into a plain text field (Apple Notes body). The pain point is an overly aggressive or misconfigured policy engine that incorrectly identifies non-sensitive input fields as credential-related, leading to `blocked_by_policy` errors. This prevents AI agents from performing basic text entry tasks, severely limiting their utility in common productivity applications. For B2B SaaS platforms enabling AI-driven mobile automation, such security policy misfires are significant operational blockers. They undermine the agent's ability to interact naturally with applications, requiring manual intervention (`phone_handoff`) and eroding trust in the automation's intelligence and reliability. Accurate context-aware policy enforcement is paramount.
Proprietary Technical Taxonomy
iOS 27.2 phone_type blocked_by_policy rule: credentials Apple Notes com.apple.mobilenotes New note input "Note" @645,918 editable focused

Raw Developer Origin & Technical Request

Source Icon GitHub Issue Nov 10, 2026
Repo: DIYgod/pinky
iOS 27: phone_type is blocked by the credentials rule in the Apple Notes note body

### What happened, or what would make Pinky better?

On iOS 27.2, `phone_type` refuses all text in the body of a new note in Apple Notes. It returns `blocked_by_policy` with `rule: credentials`. The body is a plain text view, not a password or code field.

Steps:

1. `phone_launch { app: "com.apple.mobilenotes" }`.
2. Tap **New note**. The screen shows the body as `[45] input "Note" @645,918 editable focused`. No `password` state is shown.
3. `phone_type { text: "hello" }`, then `phone_type { ref: 45, text: "hello" }`.

Result of both calls:

```text
blocked_by_policy · · rule: credentials
Pinky never types into password or one-time-code fields; call phone_handoff so the person can fill it. Nothing was done. Choose another way, or ask the person.
```

Expected: the text goes into the note.

Other checks in the same session:

- Chinese text and ASCII text give the same result.
- `phone_type` into the Notes **Search** field works.
- `phone_type` into the WeChat chat input works.

I did not find the cause. The label is `Note`, which matches no word in `passwordWords`, `otpWords` or `otpTokens` (`internal/policy/words.go`). So the block comes from the element's ID or from a `password` state that the screen text does not show (`IsCredentialField`, `internal/policy/detect.go`). I did not confirm which.

### Pinky and system

Pinky 2026.1110.2 (Homebrew cask) · macOS 27.2.1 · arm64

### Diagnostics

```text
Phone: iPhone 15 Pro Max (iPhone16,2), iOS 27.2, USB
Connection: Aut...

Developer Debate & Comments

No active discussions extracted for this entry yet.

Adjacent Repository Pain Points

Other highly discussed features and pain points extracted from DIYgod/pinky.

Extracted Positioning
Pinky Companion app installation and accessibility service activation on Android 10, specifically on Huawei devices with EMUI.
Ensuring reliable installation and activation of Pinky Companion's accessibility service for AI agent control on Android devices.
Top Replies
DIYgod • Nov 10, 2026
谢谢反馈。从截图看,Pinky Companion 其实已经装上了,卡住的是下一步:Pinky 打开它的无障碍服务以后,服务 10 秒内没有响应。红字写的「安装没有完成」是 Pinky 用错了提示,这个我们会改。 为了查清服务为什...
pigracing • Nov 10, 2026
华为的mate10手机,android 10的系统,无障碍我一直没打开,原来是要打开的啊?谢谢
DIYgod • Nov 10, 2026
不用自己去开。Pinky Companion 的无障碍服务是智能体操作手机时由 Pinky 通过 adb 自动打开的,用完就会关掉,所以平时在手机设置里看到它是关着的,这是正常的。 这次的问题是 Pinky 打开了服务,但它 10 秒内...
Extracted Positioning
AI agent UI automation (`phone_tap`) on Xiaomi HyperOS, specifically navigating system settings.
Achieving reliable UI navigation and interaction for AI agents across diverse Android OEM skins and OS versions.
Extracted Positioning
The 'Stop All' functionality within Pinky's user interface, intended to halt all active agent sessions or phone connections.
Providing reliable, immediate control over AI agent activities and device connections through the user interface.
Extracted Positioning
Pinky's ability to enable and maintain its Companion app's accessibility service on vivo OriginOS 6 devices.
Achieving broad compatibility and reliable control over diverse Android device ecosystems, specifically addressing vendor-specific OS customizations that hinder core functionality.
Extracted Positioning
Precise UI interaction for AI agents on iOS, specifically tapping switch controls by reference.
Achieving accurate and reliable AI agent control over iOS UI elements, ensuring `phone_tap` targets the intended interactive component within a larger accessibility frame.

Frequently Asked Questions

Market intelligence mapped to AI agent text input (`phone_type`) on iOS 27, specifically into non-password fields like Apple Notes body..

How is AI agent text input (`phone_type`) on iOS 27, specifically into non-password fields like Apple Notes body. positioned in the market?
Based on our AI analysis of the original developer request, its primary technical positioning is: Ensuring secure and reliable text input for AI agents across various iOS applications, without false positives for credential fields.
Are engineers actively discussing AI agent text input (`phone_type`) on iOS 27, specifically into non-password fields like Apple Notes body.?
Yes, we have tracked 2 direct responses and active debates regarding this specific topic originating from GitHub Issue.
Which technical concepts are associated with AI agent text input (`phone_type`) on iOS 27, specifically into non-password fields like Apple Notes body.?
Our proprietary extraction maps AI agent text input (`phone_type`) on iOS 27, specifically into non-password fields like Apple Notes body. to adjacent architectural concepts including iOS 27.2, phone_type, blocked_by_policy, rule: credentials.

Engagement Signals

2
Replies
open
Issue Status

Cross-Market Term Frequency

Counts stored text matches for foundational terms like USB and arm64 in analysed public discussions. These counts do not measure adoption.

Stored text matches, not adoption or market-share measurements.

  • USB: 15 records
  • arm64: 11 records
  • Apple Notes: 3 records
  • iOS 27.2: 2 records
  • phone_type: 2 records
  • blocked_by_policy: 2 records
  • rule: credentials: 2 records
  • password state: 2 records
  • com.apple.mobilenotes: 1 records
  • New note: 1 records
  • phone_handoff: 1 records
  • passwordWords: 1 records
  • otpWords: 1 records
  • otpTokens (internal/policy/words.go): 1 records
  • IsCredentialField (internal/policy/detect.go): 1 records
  • Notes Search field: 1 records
  • WeChat chat input: 1 records
  • Pinky 2026.1110.2 (Homebrew cask): 1 records
  • macOS 27.2.1: 1 records
  • iPhone 15 Pro Max (iPhone16,2): 1 records
  • input "Note" @645,918 editable focused: 0 records