arkit

I am trying to drag a node exactly where my finger is on the screen on the Y -axis. But I don't find any way to do it, here is my current code. Do you have any idea? var movedObject:SCNNode? @objc func handlePan(_ recognizer: UIPanGestureRecognizer) { if recognizer.state == .began { let tapPoint: CGPoint = recognizer.location(in: sceneView) let result = sceneView.hitTest(tapPoint, options: nil) if result.count == 0 { return } let hitResult: SCNHitTestResult? = result.first movedObject = hitResult?.node //.parent?.parent } else if recognizer.state == .changed { if (movedObject != nil) { let

How can i add a 2dView having text in ARkit scene iOS.How can i add that view in top of a node that won't rotate when we rotate the node. You can add a SCNPlane and use a SCNLookAtConstraint to so that the plane always looks at the camera. You can create a custom material and set it's material properties to: A color (UIColor or CGColor), specifying a constant color across the material’s surface A number ( An image (UIImage or CGImage), specifying a texture to be mapped across the material’s surface A Core Animation layer (CALayer) A texture (SKTexture, MDLTexture, MTLTexture, or GLKTextureInfo

I am building an ARKit app where we want to be able to take a photo of the scene. I am finding the image quality of the ARCamera view is not good enough to take photos with on an iPad Pro. Standard camera image: ARCamera image: I have seen an Apple forum post that mentions this could be iPad Pro 10.5 specific and is related to fixed lens position ( https://forums.developer.apple.com/message/262950#262950 ). Is there are public way to change the setting? Alternatively, I have tried to use AVCaptureSession to take a normal photo and apply it to sceneView.scene.background.contents to switch out a

There is a SCNNode category named SCNNode(SIMD) , which declares some properties like simdPosition , simdRotation and so on. It seems these are duplicated properties of the original/normal properties position and rotation . @property(nonatomic) simd_float3 simdPosition API_AVAILABLE(macos(10.13), ios(11.0), tvos(11.0), watchos(4.0)); @property(nonatomic) simd_float4 simdRotation API_AVAILABLE(macos(10.13), ios(11.0), tvos(11.0), watchos(4.0)); What's the difference between position and simdPosition ? What does the prefix "simd" mean exactly? SIMD: Single Instruction Multiple Data SIMD

While I have been researching best practices and experimenting multiple options for an ongoing project(i.e. Unity3D iOS project in Vuforia with native integration, extracting frames with AVFoundation then passing the image through cloud-based image recognition), I have come to the conclusion that I would like to use ARkit, Vision Framework, and CoreML; let me explain. I am wondering how I would be able to capture ARFrames, use the Vision Framework to detect and track a given object using a CoreML model. Additionally, it would be nice to have a bounding box once the object is recognized with

How is it possible to implement a vertical plane detection (i.e. for walls)? let configuration = ARWorldTrackingSessionConfiguration() configuration.planeDetection = .horizontal //TODO Edit: This is now supported as of ARKit 1.5 (iOS 11.3). Simply use .vertical . I have kept the previous post below for historical purposes. TL;DR Vertical plane detection is not (yet) a feature that exists in ARKit. The .horizontal suggests that this feature could be being worked on and might be added in the future. If it was just a Boolean value, this would suggest that it is final. Confirmation This suspicion

I'm trying to estimate my device position related to a QR code in space. I'm using ARKit and the Vision framework, both introduced in iOS11, but the answer to this question probably doesn't depend on them. With the Vision framework, I'm able to get the rectangle that bounds a QR code in the camera frame. I'd like to match this rectangle to the device translation and rotation necessary to transform the QR code from a standard position. For instance if I observe the frame: * * B C A D * * while if I was 1m away from the QR code, centered on it, and assuming the QR code has a side of 10cm I'd see

I would be interested to know, where are the advantages and disadvantages of each vision-based mobile Augmented Reality Frameworks? For what should be decide in which case? Would you choose Vuforia in any case, because it is free and without branding? What are important features are missing in one of the frameworks? Are there limits on the free version of Metaio SDK (except branding and Metaio splash-screen)? I think these are the most important Frameworks to support iOS and Android. I know that metaio support movie textures and MD2 (Animation) Export and Vuforia not (at least not in the basic